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(g) Video signal transmission system and method and apparatus for coding a video signal. 

(S?) In a video signal transmission system, in which video signals are transformed to high efficiency coded 
data and are then transmitted, a quantization step size is enlarged in quantizing picture data intra coded 
to be effectively avoided the amount of data generated excessively increasing. The data residual amount 
of transmission buffer memory is set to a small level as compared to the data residual amount at which 
the frame dropping is completed. Video signals which are intra coded are then sent immediately after a 
transmission line is connected to a destination to be enhanced In facility. 
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VIDEO SIGNAL TRANSMISSION SYSTEM AND METHOD AND APPARATUS FOR CODING 

VIDEO SIGNAL 



This invention relates to a video signal transmission system, and more particularly is suitably applied to a 
case in which video signals are transformed to high efficiency coded data and are then transmitted, for example. 

In the picture phone system and the video conference system, heretofore there has been proposed a video 
signal transmission system in which video signals which constitute moving pictures are high efficiency coded 

5 to provide intra coded frame data and inter coded frame data, and thereby the moving picture video signals 
are transmitted through transmission lines with relatively strict limits in transmission capacity (Japanese Patent 
Laid-open Publication No. 63 (1988)-1183). 

More specifically, in a case where pictures PC1, PC2, PC3, ... which constitutes moving pictures at res- 
pective times t = t1, t2, t3, ... are transmitted as shown in FIG. 1, the transmission efficiency is enhanced by 

10 compressing the picture data to be transmitted, using a fact that video signals are large in autocorrelation 
according to the lapse of time. In the intra coding, pictures PC1 , PC2 f PC3, ... are compressed in such a manner 
that differences are determined by comparing pixel data with a predetermined reference value. Thus, picture 
data of each picture PC1 , PC2, PC3, ... is transmitted at an amount of data compressed using the autocorre- 
lation between pixel data in the same frame. 

15 In the inter coding, picture data PC12, PC23, ... which are differences between two successive pictures 

PC1 and PC2, PC2 and PC3 respectively, are determined as shown in FIG. 1 , and are transmitted together 

with the intra coded picture data of the original picture PC1 at the time t = t1. 

Thus, it is possible to send the pictures PC1, PC2, PC3, ... In the format of high efficiency coded digital 
data which is markedly small in amount as compared to data in a case where all the picture data is sent 

20 The coding of such picture signals is achieved by a picture data generating system 1 having a configuration 
shown in FIG. 2. 

The picture data generating system 1 performs processing operations, such as every other field dropping 
and every other field line dropping, on input video signals VD in a preprocessing circuit 2. Subsequently, the 
luminance signals and chrominance signals thereof are transformed to transmission unit block (referred to as 
25 macro block) data S11 which is 16 pixels (horizontal) x 16 pixels (vertical) data, and are then fed to a picture 
data coding circuit 3. 

The picture data coding circuit 3 accepts predicted current frame data S12 constructed in a prediction cod- 
ing circuit 4, and determines the difference between the predicted current frame data S12 and the macro block 
data S1 1 to produce inter coded data (this is referred to as inter coding mode) or the difference between the 

30 macro block data S1 1 and the reference data to generate intra coded data. This data is fed to a transform coding 
circuit 5 as differential data S13. 

The transform coding circuit 5 consists of a discrete cosine transform circuit and provides transform coded 
data S14, high efficiency coded by orthogonal transforming the differential data S13. to a quantizer 6, which 
sends quantized picture data S15. 

35 The quantized picture data S15 thus obtained from the quantizer 6 Is high efficiency coded again in a 
retransform coding circuit 7 which includes a variable length coding circuit and is then fed as transmission pic- 
ture data S16 to a transmission buffer memory 8. 

Moreover, the quantized picture data S15 undergoes inverse quantization and inverse transform coding 
operations in the prediction coding circuit 4, so that the quantized picture data S15 is decoded to differential 

40 data. Then, the predicted previous frame data is modified by the differential data, and thereby new predicted 
previous frame data is stored. Furthermore, the predicted previous frame data which is stored in the prediction 
coding circuit 4 is motion compensated by motion detection data, which has been constructed on the basis of 
the macro block data S 1 1 , to produce predicted current frame data for feeding to the picture data coding circuit 
3. Thus, the difference between the macro block data S1 1 of a frame (current frame) which Is to be transmitted 

45 and the predicted current frame data S12 Is obtained as the differential data S13. 

When the motion pictures mentioned referring to FIG. 1 are sent with the construction of FIG. 2, the picture 
data of the picture PC1 is firstly provided as macro block data S1 1 at the time t1 in FIG. 1. In this event, the 
picture data coding circuit 3 is placed in the intra coding mode, and provides this data as intra coded differential 
data S1 3 to the transform coding circuit 5. In this mann r, transmission picture data S1 6 is fed t the transmis- 

50 sion buffer memory 8 through the quantizer 6 and the retransform coding circuit 7. 

On the other hand, the quantized picture data S15 obtained at the output of the quantizer 6 is prediction 
coded in the prediction coding circuit 4, and thereby predicted previous frame data which represents the trans- 
mission picture data S16 sent to the transmission buffer memory 8 is held in the pr vious frame memory. When 
macro block data S11 which represents the picture PC2 at the time t2 Is fed to the picture data coding circuit 
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3, the predicted previous frame data is motion compensated to produce the predicted current frame data S12 t 

which is provided to th pictur data coding circuit 3. 

Thus, the picture data coding circuit 3 provides differential data S13 inter coded to the transform coding 

circuit 5 at the time t = t2. In this manner, the differential data which represents changes in picture between 
5 the frames is sent as transmission picture data S16 to the transmission buffer memory 8 while the quantized 

picture data S1 5 thereof is provided to the prediction coding circuit 4 to thereby construct and store predicted 

previous frame data in the prediction coding circuit 4. 

Only the differential data representing changes in picture between the frames is sequentially transmitted 

to the transmission buffer memory 8 by repeating similar operations during the inter coding operation of the 
10 picture data coding circuit 3. 

The transmission buffer memory 8 accumulates transmission picture data S1 6 which has been reached in 

this manner, and successively sends the accumulated transmission picture data S16 as transmission data D. 

trans to a transmission line 9 at a data transmission rate which is determined according to the transmission 

capacity of the transmission line 9. 
15 Concurrently, the transmission buffer memory 8 detects the amount of residual data to feed back residual 

amount data S17, which changes according to the amount of the residual data, to the quantizer 6, and thereby 

the quantization step size is controlled according to the residual amount data S17 to regulate the amount of 

data generated as the transmission picture data S1 6, so that an appropriate amount of the residual data (not 

to produce overflow or underflow) is kept in the transmission buffer memory 8. 
20 When the amount of residual data in the transmission buffer memory 8 increases to a permissible upper 

limit, rough quantization is carried out in the quantizer 6 by enlarging the step size of the quantization step STPS 

(FIG. 3) of the quantizer 6 on the residual amount data S17, so that the amount of the transmission picture 

data S16 is reduced. 

On the contrary, when the amount of the residual data in the transmission buffer memory 8 decreases to 
25 a permissible lower limit, the residual amount data S1 7 controls the step size of the quantization step STPS of 
the quantizer 6 to a smaller value, and thus the amount of generation of data of the transmission picture data 
S16 is increased by executing fine quantization in the quantizer 6. 

More specifically, in the transmission system, an evaluation function is detected stepwise by a motion vec- 
tor detection circuit with reference to a picture of a predetermined frame (hereinafter referred to as reference 
30 frame). 

Moreover, in the transmission system the picture of the reference frame is shifted by the motion vector to 
produce a comparison reference picture, and then detects differential data between that comparison reference 
picture and the picture to be transmitted. The differentia) data is transmitted together with the motion vector. 

In the receiving system, the reference frame picture previously transmitted is moved by the motion vector 
35 sent, and then the differential data sent is added to reconstruct the original picture. 

In the conventional picture data generating system 1 , the transmission buffer memory 8 is, as described, 
provided as means for transmitting significant picture information whOe matched to a transmission condition in 
which the data transmission rate of the transmission data Dtrans is limited according to the transmission 
capacity of the transmission line 9, and thereby picture data is accumulated in the transmission buffer memory 
40 so that the picture data of the transmission capacity of the transmission line 9 may be sent without excess or 
deficiency. However, it is possible in practice that the transmission buffer memory 8 overflows when the amount 
of picture data generated in the picture data generating system 1 becomes extremely large. 

Moreover, in the picture data generating system 1 of such a construction, there is a problem in that the 
transmission buffer memory overflows due to an increase of the amount of generation of coded transmission 
45 data when moving pictures to be transmitted are rapidly moving picture or contents of thereof changes greatly, 
for example, as in a change of a scene. 

As one technique to solve the problem, there is studied a frame dropping technique in which subsequent 
frames are not coded when the amount of generation of transmission data is excessively increased. 

In a case where rapidly moving pictures are sent for a relatively long time, frame dropping operations are 
so however repeated often since the amount of the generation of the transmission data continues to increase. 
Thus, there is a problem in that visual smoothness of movement of the reproduced moving pictures is lost, and 
hence this technique is not still suffici nt for sending moving pictures. 

Furthermore, incidentally, in such a type of vid o signal transmission system in inter coding processing, 
onefram of a pictur isdivRJ d to a plurality of regions (hereinafter referred to as macro blocks) and a motion 
55 vector Is detect dfor ach macro block. 

More specifically, within a predetermined motion vector d tection range the picture of a r ference fram 
is sequentially moved relativ ly to each macro block, and thereby a shift position (which provid s the motion 
vector) where the differential data is the smallest in amount is detected. 
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The picture of the reference frame is further moved to the det ct d shift position to detect picture data of 
a region which corresponds to the macro block, and thereby picture data of a comparison ref rence for detection 
of differential data is produced. 

By repeating this processing, the differential data is detected for each macro block, and is then sent after 
5 discrete cosine transformation, quantization, variable length coding. 

Thus, in such a type of video signal transmission system, there is a case where picture data is coded in 
such a way that boundaries between macro blocks become obtrusive when a motion vector is detected for each 
macro block. 

To make these boundaries unobtrusive, there has been considered a technique in which in detecting dif- 
10 ferential data a high frequency zone of picture data for comparison reference is suppressed by means of a filter 
circuit as disclosed in Japanese Patent Laid-open Publication 60(1985)-206,318, for example. 

For making the boundaries unobtrusive by suppressing a high frequency zone of picture data for compari- 
son reference, it is necessary to change the characteristic of the filter according to the position of picture data, 
and there is hence a problem in that kinds of filter circuits are practically needed for real time processing. 
15 Furthermore, a picture of the reference frame is necessary for an inter coding processing to decode the 
original picture data. 

For this reason, in this type of the video signal transmission system an immediately previous frame, for 
example, is selected as the reference frame, and picture data intra coded is sent in place of differential data 
Inter coded for each predetermined frame. 
20 The intra coding is a processing to code picture data at a high efficiency using a correlation in the frame 
and is Inferior in transmission efficiency of picture data to the Inter coding processing but the original picture 
can be reconstructed by only the picture data sent 

Accordingly, the original picture data can be reconstructed on the basis of the differential data transmitted 
if the Immediately previous frame is intra coded, and if with that frame selected as the reference frame, picture 
25 data of the subsequent frame is inter coded. 

Moreover, on the basis of the picture data reconstructed in this manner picture data of the subsequentframe 
can be also reconstructed. 

In such a type of the video signal transmission system, the line is connected after the coding of picture 
data is commenced. 

30 Thus, inter coding may be repeated just after the line is connected. In this case, any correct picture cannot 
be reconstructed at the receiving end until picture data intra coded is sent. 

More specifically, in a case where picture data intra coded is sent every 128 frames, for example, the 
speaker at the receiving end must talk, monitoring an unnatural picture displayed for about 13 seconds at 
maximum when the frame frequency of the picture data is 10 Hz. Thus, there is a problem in facility. 

35 

SUMMARY OF THE INVENTION 

In view of the foregoing, an object of this invention is to provide a video signal transmission system which 
prevents an excessively large amount of quantized data from being produced by determining the quantization 
40 step size according to the format of picture data to be quantized. 

Another object of this invention is to provide a video signal transmission system which performs frame drop- 
ping while moving pictures are kept as visually smooth in movement as possible. 

Another object of this invention is to provide a filter circuit for using suitably a video signal transmission 
system. 

45 Another object of this Invention is to provide a video signal transmission system which is capable of enhanc- 
ing facility as compared to the prior art by effectively avoiding unnatural display pictures. 

A first aspect of the invention provides a video signal coding method and apparatus in which video signals 
VD are alternatively intra and inter coded and are then quantized for transforming to picture data, the quanti- 
zation Is. according to the present invention, executed by enlarging the quantization step size QNT to a pre- 
50 determined rough quantization level QNT = 31 when the picture data to be quantized is In an intra coded format. 
When picture data which has been high efficiency coded in an inter or intra coding mode is quantized, the 
amount of the picture data of which type is inter coded data is extremely large. 

When a judged format of picture data to be quantiz d is an intra coding format, th quantization st p size 
is enlarged. In this manner, it is possibl to ffectively restrain the amount of plctur data generated by the quan- 
55 tization from becoming excessively fang - 

Moreov r, a second aspect of the invention provides a vide signal coding system and method which 
includes a transmission buffer circuit 32. In the video signal coding system, transmission pictur data SAO high 
efficiency coded is temporarily stored in the transmission buffer circuit 32, and the transmission picture data 
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S40 stored is s quentially outputted t a transmission lin 43 according to a data transmission capacity f the 
transmission lin 43, fram dr pping f th transmission picture data S40 is xecuted when a data residual 
amount "Buffer" of the transmission buffer circuit 32 exceeds a predetermined upper limit (QNT = 31); and the 
frame dropping Is completed when the data residual amount "Buffer" of the transmission buffer circuit 32 

5 reduces to a predetermined desired value level MG (QNT = 1) smaller than the upper limit (QNT ~ 31). 

When the data residual amount "Buffer" of the transmission buffer memory 32 exceeds the upper limit (QNT 
» 31), the frame dropping operation is instructed to be carried out, and then the frame dropping operation is 
completed when the data residual amount "Buffer* becomes below the desired value MG (QNT = 1) smaller 
than the upper limit (QNT = 31). In this manner, it is avoided that the frame dropping operation is resumed at 

10 once even when the data residual amount "Buffer* is rapidly increased after the previous frame dropping oper- 
ation is completed, and moreover it is possible to quickly converge the data residual amount "Buffer* at the 
desired value MG (QNT = 1) when the amount of generation of data decreases after the frame dropping oper- 
ation is completed. 

In this manner, the output pictures can be made smooth in movement and degradation in picture quality 

15 thereof can be avoided. 

Furthermore a third aspect of the invention provides a vertical digital filter circuit having a plurality of delay 
circuits 101 A and 101B in series, each of the delay circuits 101 A and 101 B outputting picture data consecutive 
in the vertical scanning direction; a vertical selection circuit 102A, 102B and 104 for selectively outputting the 
picture data outputted from the vertical digital filter circuit; a horizontal digital filter circuit having a plurality of 

20 delay circuits 1 07A, 1 07B and 1 07C in series, each of the delay circuits 1 07A, 1 07B and 1 07C outputting picture 
data consecutive in the horizontal scanning direction; and a horizontal selection circuit 108A, 108B and 109 
for selectively outputting the picture data outputted from the horizontal digital filter circuit; and wherein: picture 
data Dpri are sequentially inputted to the vertical digital filter circuit or the horizontal digital filter circuit; the output 
data D v or D H of the vertical selection circuit 1 02A, 1 02B and 1 04 or the horizontal selection circuit 1 08A, 1 08B 

25 and 109 is fed to the horizontal digital filter circuit or the vertical digital niter circuit; the picture data D PR0 out- 
putted from the horizontal selection circuit 1 08A, 1 08B and 1 09 or the vertical selection circuit 102A, 1 02B and 
104 is corrected by switching the selective outputs from the vertical selection circuit 102A, 102B and 104 and 
the horizontal selection circuit 108A, 108B and 109. The invention also provides a corresponding method of 
digital filtering. 

30 In the vertical digital filter circuit 101 A and 101 B, and the vertical selection circuit 102A, 102B and 104, 
picture data consecutive in the vertical scanning direction are selectively outputted, respectively whereas in 
the horizontal digital fdter circuit 107A, 107B and 107C and the horizontal selection circuit 108A, 108B and 109, 
picture data consecutive in the horizontal scanning direction are selectively outputted, respectively. In this 
event, the picture data D PRI is sequentially inputted, and at the same time output data of the vertical selection 

35 circuit 102A, 102B and 104 or the horizontal selection circuit 108A, 108B, and 109 is outputted to the horizontal 
digital filter circuit 107A, 107B and 107C or the vertical digital fflter circuit 101A and 101B, and thereby the 
characteristic of the filter is switched depending on selective outputs from the vertical selection circuit 102A, 
102B and 104 and the horizontal selection circuit 108 A, 108B, and 109. 

Furthermore, a fourth aspect of the present invention provides a video signal transmission system 161 and 

40 method in which video signals are transmitted by repeating inter coding and intra coding at a predetermined 
cycle, according to the present invention the video signals D )N of a predetermined frame are intra coded and 
then sent after a line L1 is connected to a transmission destination. 

When video signals D iN of a predetermined frame are intra coded and then sent after a line L1 is connected 
to a transmission destination, a picture which was sent just after the line was connected can be reconstructed 

45 in the destination, and the speaker may monitor the picture. 

A fifth aspect of the invention provides: a video signal transmission system in which video signals are trans- 
mitted by repeating inter coding and intra coding at a predetermined cycle, characterised in that 
the video signals of predetermined frames are intra coded and then transmitted after a line is connected to a 
destination ; and a corresponding apparatus for performing the method. 

so A sixth aspect of the invention provides: a video signal coding method in which video signals are alterna- 
tively intra and inter coded and are then quantized for transforming to picture data, characterized in that 
a power f said picture data is calculated when said pictur data to be quantized is a data int r coded, and 
then said quantization is executed with a quantization step siz which is reduced data a predetermined ratio 
to a quantization step size of a previous frame when said pow r of picture data calculated is smaller than a 

55 predetermined threshold value; and a corresponding apparatus for performing the m thod 

Any or all of the above asp cts of th inv ntion may be combined to provid improved systems and 
methods. 

The invention will be further described by way of non-limitative example with ref rence to the accompanying 
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drawings in which like parts are designated by lik reference numeralsor characters: 

FIG. 1 is a schematic diagram for illustrating th inter/intra frame coding; 

FIG. 2 is a block diagram illustrating the conventional pictur data gen rating system; 

FIG. 3 is a graph showing the quantization step thereof; 
5 FIGS. 4A, 4B and 5 are block diagrams ilustrating the encoder and decoder which constitutes the picture 

Information transmission system using the video signal coding method according to the present invention; 

FIG. 6 is a schematic diagram showing the construction of the frame picture data; 

FIG. 7 is a block diagram illustrating the header 

data processing system of FIG. 4; 
w data processing system of FIGS. 4A and 4B; 

FIG. 8 is a schematic diagram showing the 

construction of the flag data of FIG. 7; 

construction of the flag data of FIGS. 7A and 7B; 

FIG. 9A and 9B are flowcharts showing the quantization step size determining routine of the quantization 
15 control unit 36 of FIG. 4; 

FIG. 10 is a graph illustrating changes of residual data in the transmission buffer memory 32 of FIG. 4B ; 

FIG. 1 1 is a table showing types of macro blocks; 

FIG. 12 is an illustration of the transform coefficient matrix; 

FIG. 1 3 is the characteristic curve illustrating changes of the data residual amount of the transmission buffer 
20 memory due to the frame dropping according to the second embodiment of the present Invention; 

FIG. 14 is a graph illustrating the accumulated value of the transmission picture data inputted to the trans- 
mission buffer memory; 

FIG. 15 is a block diagram illustrating the video signal transmission system according to the third embodi- 
ment of the present invention; 
25 FIG. 16 is a block diagram showing the differential data producing circuit; 

FIG. 17 is a block diagram illustrating the loop filter circuit; 

FIGS. 18 to 22 are schematic diagrams showing the operation thereof; 

FIGS. 23 and 24 are block diagrams illustrating decoder circuits; 

FIGS. 25 and 26 are schematic diagrams illustrating other embodiments; 
30 FIG. 27 is a block diagram illustrating the videophone system in accordance to the fourth embodiment of 

the present invention; and 

FIG. 28 is a signal wave form diagram illustrating the operation thereof. 

Preferred embodiments of this Invention will be described with reference to the accompanying drawings: 

35 (1) The whole construction of the picture information transmission system of the first embodiment 

In FIGS. 4A, 4B and 5, a picture information transmission system 21 consists of an encoder 21 A and a 
decoder 21 B. The encoder 21 A preprocesses an input video signal VD W in an input circuit unit 22 and then 
sends an input picture data S21, which is a pixel data of 16 by 16 pixels, that is, a pixel data of a macro block 

40 MB, from an analog/digital conversion circuit 23 to a pixel data processing system SYM1 . At the timing of pro- 
cessing the pixel data in the unit of the macro block MB in each processing step of the pixel data processing 
system SYM1, a processing information data corresponding to the data to be processed is sequentially trans- 
mitted through a header data processing system SYM2. Thus, pixel data and header data are processed by 
the pipe line technique in the pixel data processing system SYM1 and the header data processing system 

45 SYM2, respectively. 

In this embodiment, macro block data which is sequentially sent as the input picture data S21 is extracted 
from frame picture data FRM according to a technique sown In FIG. 6, 

Firstly, frame picture data FRM of a picture is separated into 2 (horizontal direction) x 6 (vertical direction) 
of block groups GOB. Each block groups GOB contains 1 1 (horizontal direction) x 3 (vertical direction) of macro 
so blocks MB. Each macro block MB contains 16 by 16 pixels of luminance signal data Yqo - Y t1 (each consisting 
of 8 by 8 luminance signal data) and chrominance signal data C b and C f which Is chrominance signal data cor- 
responding to all the pixel data of the luminance signal data Y 00 - Y„. 

Thus, the input picture data S21 which is sent for each macro block MB is fed to a motion compensation 
circuit 25. The motion compensation circuit 25 compares th input picture data S21 and predicted previous 
55 frame data S23 from a predicted previous frame memory 27 in response to a motion detection control signal 
S22 fed from a motion compensation control unit 26, which is provided in the header data processing system 
SYM2, and th moti n compensati n circuit 25 thereby detects motion vector data "MVDfx)" and "MVD(y)", 
which are supplied as first header data HD1 (FIGS. 7A and 7B) to the motion compensation control unit 26. 



7 



EP0444 839 A2 



Furthermore, the motion compensation circuit 25 constructs predicted current frame data S24 by motion com- 
pensating the predicted previous fram data S23 by the motion vector data "MVD(x)" and "MVD(y)" in a m tion 
compensation circuit body 25A. The predicted current frame data S24 is fed t a pictur data coding circuit 28 
together with the input picture data S21 to be processed. 

5 As shown in FIGS. 7A and 7B, the motion compensation control unit 26 Identifies each macro block MB, 

which is sequentially transmitted to each processing step of the pixel data processing system SYM1, by adding 
the following data as the first header data HD1 for the macro block MB: transmission frame number data TR 
Counter" representing a transmission sequence of the frame picture data FRM; block group number data "GOB 
address" representing the block group GOB (FIG. 6); macro block number data "MB address" representing the 

10 macro block MB among the block group GOB. Moreover the motion compensation control unit 26 constructs 
flag data FLAGS representing a processing or a processing type of the macro block MB to be processed, the 
motion vector data "MVD(x)° and "M VD(y)" of the macro block MB, and differential data "I |A-B| " which rep- 
resents the evaluation. 

As shown in FIG. 8, the flag data "FLAGS" can have one word (16 bits) of flags at maximum. A motion 
15 compensation control flag M MC on/off which represents whether or not the macro block MB to be processed 
should be processed in motion compensation mode Is set at bit 0. 

At bit 1 of the flag data "FLAGS", inter-frame/intra-frame flag "Inter/lntra" which represents whether the 
micro block MB to be processed should be in inter coding mode or in intra coding mode Is set 

At bit 2 of the flag data "FLAGS", a filter flag "Filter on/off" which represents whether or not a loop filter 
20 25B of the motion compensation circuit 25 is used is set 

At bit 3 of the flag data "FLAGS", a transmission flag "Coded/IMot-coded" which represents whether or not 
block data Yoo - C r (FIG. 6) contained in the macro block to be processed should be sent can be set. 

At bit 4 of the flag data "FLAGS", a drop frame flag "Drop frame flag" which representing whether or not 
the macro block MB to be processed is frame dropped can be set. 
25 At bit 5 of the flag data "FLAGS", an forced refreshing flag "Refresh on/off" which represents whether or 
not the macro block MB to be processed is forcedly refreshed can be set. 

At bit 6 of the flag data "FLAGS", a macro block power appreciation flag "MBP appreciate" may be set 

The differential data Z I A-B| represents a minimum value among differences between the macro block 
data "A" to be processed of current flame data S25 and macro block data "B" compensated by detection motion 
30 vectors of the predicted previous frame data S23, and enables appreciation of detected motion vectors. 

In the inter coding mode, the picture data coding circuit 28 feeds the current flame data S25, which is pro- 
vided from the motion compensation circuit 25. as difference data S26 to a transform coding circuit 29 without 
any change (FIGS. 4A and 4B). On the other hand, In the intra coding mode difference data S26 which is the 
difference between the pixel data of the current flame data S25 and the pixel data of the predicted current frame 
35 data S24 is fed to the transform coding circuit 29. 

In the header data processing system SYM2, an inter/lntra coding control unit 30 is provided to correspond 
to the picture data coding circuit 28. According to the first header data HD1 , fed from the motion compensation 
control unit 26, and the operation data S3 1 , supplied from the picture data coding circuit 28, the inter/intra coding 
control unit 30 operates data necessary for obtaining the inter-frame/intra-frame flag "Inter/lntra" and the filter 
40 flag "Filter on/off* (FIG. 8) and sends the resulting data as a second header data HD2 to a fitter control unit 31 ; 
the inter-frame/intra-frame flag "Inter/lntra" is to indicate the coding mode of the picture data coding circuit 28 
whereas the filter flag "Filter" is to control the operation of the loop filter 25B of the motion compensation circuit 
25. 

As shown in FIGS. 7A and 7B, the second header data HD2 takes over the data which constitutes the first 
45 header data HD1 ; the transmission frame number data "TR Counter" to the differential data "I I A-B I ". Fur- 
thermore, in the inter/intra coding control unit 30, power data which is necessary to construct inter/intra coding 
mode switching signal S33 and filter on/off signal S34 in the filter control unit 31 is added to the second header 
data HD2, the power data including "I (A)*(L)" and "I (A)*(H)", T (A-B)2(L)" and "Z (A-B)*(H)", "I (A-FB)2(L)" 
and "E (ArFBftH)" and "2 (A)". 
so The power data "E (A)*(L)" and "Z (A)2(H)" represent the lower bit and the upper bit of the sum of the squares 
of macro block pixel data "A" of the current flame data S25, respectively. The power data "I (A-B)2(L)" and "E 
(A-B) 2 (H)' repres nt the lower bit and the upper bit of the sum of the squares of the diff re nee "A-B" of the macro 
block pixel data "A" of th current flame data S25 and macro block pixeldata "B" of the predicted current frame 
data S24, which is constructed without passing through the loop filter 25B, respectively. Th "2 (A-FB) 2 (L)" and 
55 "2 (A-FBJ^H)" repres nts the lower bit and the upper bit of th sum of the squares of the diff renc "A-FB" f 
the macro block pixel data "A" of the current flame data S25 and macro bl ck pixel data "FB" of the predicted 
current frame data S24, which is construct d through the loop filter 25B, resp ctively. The "X (A)" repr sents 
the sum of the macr block pixel data "A" of the current flame data S25. To evaluate the magnitude of each 
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data t be processed, the amount of the data is expressed in power value (each sum of the squares is obtained 
as a value irrespective of sign). 

According to the second header data HD2 fed from the inter/intra coding control unit 30 and residual amount 
data S32 fed from a transmission buffer memory 32, the filter control unit 31 sends an inter/intra coding mode 
5 switching signal S33 to the picture data coding circuit 28 and a filter on/off signal S34 to the loop fBter 25B, and 
furthermore the filter control unit 31 adds the filter flag "Filter on/off 1 , representing the contents of the filter on/off 
signal S34, to the second header data HD2 and hands over the resulting data as third header data HD3 to a 
threshold control unit 35. 

Here, the filter control unit 31 firstly controls the picture data coding circuit 28 to the Intra coding mode when 
w transmission data inter frame coded becomes larger in amount than the transmission data intra frame coded. 
Secondly, according to the filter on/off signal S34 the filter control unit 31 controls the loop filter 25B not 
to perform the filtering operation when during the processing in the inter coding mode, the predicted current 
frame data S24 which has not been processed in the loop filter 25B is smaller in the differential value than the 
predicted current frame data S24 which has been processed there. 
is Thirdly, the filter control unit 31 switches the picture data coding circuit 28 to the intra coding mode accord- 
ing to the inter/intra coding mode switching signal S33 in the forced refreshing mode. 

Fourthly, the titer control unit 31 detects a state in which the transmission buffer memory 32 is liable to 
overflow data according to the residual amount data S32 provided from the transmission buffer memory 32 and 
thereby sends to the threshold control unit 35 the third header data HD3 which contains a flag to command to 
20 execute a frame dropping procedure. 

Thus, the picture data coding circuit 28 supplies to the transform coding circuit 29 difference data S26 which 
has been encoded in such a mode that the difference between the current frame data S25 and the predicted 
current frame data S24 becomes minimum. 

As shown in FIGS. 7A and 7B, the third header data HD3 takes over transmission frame number data TR 
25 Counter" to motion vector data "MVD(x)" and "MVD(y)" from the second header data HD2, and the filter control 
unit 31 adds 6 bits of fBter flag "Fflter on/off* which correspond to the block data Yqo to C r to the third header 
data HD3. 

The transform coding circuit 29 is a discrete cosine transform circuit and sends to a transmission block 
setting circuit 34 transformation code data S35 which is obtained by zigzag scanning discrete cosine transfer- 

30 med coefficients per six blocks Yqo, Y 0 i, Y 10 , Y 11( C b and C f . 

The transmission block setting circuit 34 computes the sum of squares of coefficient data in the number 
of n from the leading data about each of the six block data Y w to C r (FIG. 6) and hands over the result of the 
operation as power detection data S36 to the threshold control unit 35. 

In this event, the threshold control unit 35 compares the power detection data S36 of each block data Yqo 

35 to C r with predetermined threshold and thereby constructs 6 bits of transmission permitted/not-permitted data 
"CBPN" which represents that the block data is not permitted to be transmitted when the power detection data 
S36 is smaller than the threshold whereas the block data is permitted to do so when the power detection data 
S36 is larger than the threshold. This data is added to the third header data HD3 which has been received from 
the filter control unit 31. The threshold control unit 35 hands over the resulting data to a quantization control 

40 unit 36 as fourth header data HIM and controls the transmission block setting circuit 34 to send corresponding 
block data Yqo to C r as transmission block patterning data S37 to a quantizer 37. 

Here, as shown in FIGS. 7Aand 7B the fourth header data HD4 takes over the transmission frame number 
data "TR Counter" to filter flag "Filter on/off of the third header data HD3, and 6 bits of the transmission per- 
mitted/not-permitted flag ^CBPIM", which has been generated at the threshold control unit 35 to correspond to 

45 the blocks Yqo to C r . is added to the fourth header data HD4. 

On the basis of the fourth header data HD4 hand ed over from the threshold control unit 35 and the residual 
amount data S32 sent from the transmission buffer memory 32, the quantization control unit 36 performs a quan- 
tization step size determination routine RTO shown in FIGS. 9A and 9B, and thereby provides a quantization 
step size control signal S38 to the quantizer 37, thus causing the quantizer 37 to perform the quantization pro- 

so cedure at the quantization step size which matches to the data contained in the macro block MB. Consequently, 
quantized picture data S39 which has been obtained at the output terminal of the quantizer 37 is fed to a variable 
length coding circuit 38. 

In addition to this, according the fourth h ader data HD4 th quantization control unit 36, as shown in FIGS. 
7A and 7B, constructs as header data HD5 data in which the flag data "FLAGS" and the motion vector data 
55 "MVD(x)" and H MVD(y)" are separated and arranged In series to correspond to each f the block data Yqo to 
Q (FIGS. 6), and the quantization control unit 36 hands the header data HD5 to the variable length coding circuit 
38 and an inverse quantiz r 40. 

As shown in FIGS. 7A and 7B, the header data HD5 takes over the transmission frame number data TR 
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Counter" t the macro block MB address In the fourth header data HD4 without any change, and the quantization 
control unit 36 adds quantization size data "QNT" and flag data "FLAGS" f r the block data Yoo to C r and motion 
v ctor data mvdoo and mvom to the header data HD5. 

The variable length coding circuit 38 performs variable length coding on the header data HD5 and the quan- 
5 tized picture data S39 to construct transmission picture data S40, which is supplied to the transmission buffer 
memory 32. 

In variable length coding the block data Y 00 to C„ the variable length coding circuit 38 performs processing 
to throw away the block data without sending as transmission picture data S40 when "frame dropping" or "trans- 
mission not permitted" is instructed according to the corresponding flag data "FLAGS". 

10 The transmission buffer memory 32 stores the transmission picture data S40, which is read at a predeter- 
mined transmission rate and is composed with transmission voice data S41, sent from a voice data generator 
42, in the multiplexer 41 to be sent to the transmission line 43. 

The inverse quantizer 40 inverse quantizes the quantized picture data S39, sent from the quantizer 37, 
according to the header data HD5, and then feeds the inverse quantization data S42 to inverse transform coding 

15 circuit 43 for converting to inverse transform coded data S43 t which is then fed to a decoder circuit 44. Thus, 
coded differential data S44 which represents picture Information sent as the transmission picture data S40 Is 
supplied to the predicted previous frame memory 27. 

In this event, the predicted previous frame memory 27 performs correction of the predicted previous frame 
data stored using the coded differential data S44 to store as new predicted previous frame data. 

20 Thus, in the encoder 21 A of the configuration in FIG. 4, the pixel data processing system SYM1 pipelines 
pixel data in the unit of a macro block MB according to the header information fed from the header data pro- 
cessing system SYM2. Simultaneously with this, header data is transferred in the header data processing sys- 
tem SYM2, and thereby the pixel data is appropriately processed according to needs by performing of addition 
or deletion of the header data in each process of the header data processing system SYM2. 

25 As shown in FIG. 5, In the decoder 21 B the transmission data transmitted from the encoder 21 A through 
transmission line 43 is accepted in a transmission buffer memory 52 through a demultiplexer 51 while trans- 
mission voice data S51 is received in a voice data receiving unit 53. 

The pixel data received in the transmission buffer memory 52 is separated into received picture data S52 
and header data HD1 1 in a variable length inverse transform circuit 54. The received picture data S52 is inverse 

30 quantized to form inverse quantized data S53 in an inverse quantizer 55, and is then inverse transformed to 
inverse transform coded data S54 by discrete inverse transformation in an inverse transform coding circuit 56. 

The Inverse transform coded data S54 Is fed to a decoder circuit 57 together with header data HD12 con- 
structed in the inverse quantizer 55, and is then stored as coded differential data S55 in a frame memory 58. 
Thus, the pixel data transmitted is decoded in the frame memory 58 on the basis of the coded differential 

35 data S55. In a digital/analog conversion circuit 59, the decoded picture data S56 is converted to an analog sig- 
nal, which is then outputted as a output video signal VD 0U t through an output circuit unit 60. 

(2) Procedure to determine the Quantization Step Size 

40 The quantization control unit 36 executes the quantization step size determining routine RTO, shown in 
FIGS. 9A and 9B, on each macro block MB, and thereby a quantization step size QNT is selected to adapt to 
a format of picture data of the macro block MB to be currently processed (referred to as macro block type) to 
feed as the quantization step size control signal S38 to the quantizer 37. In this manner, the quantizer 37 is 
controlled not to produce disturbance of the picture according to the type of macro blocks. 

45 In this embodiment, the quantizer 37 is, as shown in FIG. 10, designed so that the quantization step size 
QNT is stepwisely variable from an upper limit QNT = 31 to a lower limit QNT = 1 . The quantization control unit 
36 performs an adaptive control in response to the macro block type "Macro Block Type" so that the data resi- 
dua) amount "Buffer" of the transmission buffer memory 32 fails within the variable control range of the quan- 
tization step size QNT, that is, the range of the quantization size controllable range QCR. 

so (2-1) Processing in a case where the amount of the residual data is excessive 

When entering the quantization step size determining routine RTO of FIGS. 9A and 9B, in the step SP1 the 
quantization control unit 36 makes a judgement as to wheth r r not th data residual amount "Buff r" f the 
transmission buffer memory 32 is larger than the sum of the margin "Margin" and th quantization size con- 
trollabl rang QCR. 

55 When an affirmative result is obtained, this means that th data residual amount "Buffer* of the transmission 
buff r memory 32 is above th upper limit. In this case, the quantization control unit 36 proceeds t the st p 
SP2, where it supplies the quantization step size control signal S38 to set the quantization step siz QNT to 
th maximum, Le, QNT =31, to the quantization control unit 36, and then goes to the st pSP3, where th quan- 
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tization step size QNT currently set Is stored as a previous frame quantization step size PQNT. 

Thus, th quantization control unit 36 compl tes the quantization step size determining routine RTO at the 
step SP4, and thereby the transform code data S35 Is quantized at the roughest quantizati n st p siz in th 
quantizer 37. 

5 As a result, the amount of data of the quantized picture data S39 generated In the quantizer 37 is controlled 
to the smallest level, so that the data residual amount 'Buffer" of the transmission buffer memory 32 decreases. 

This operation is repeated until the affirmative result is obtained at the step SP1, with the result that the 
residual data in the transmission buffer memory 32 becomes smaller in amount than the sum of the margin 
"Margin" and the quantization size controllable range OCR, QCR + Margin. 

10 (2-2) Processing In the intra coding mode 

In such a state, the quantization control unit 36 goes to the step SP5 since a negative result is obtained in 
the step SP1 , and In that step it is judged whether or not the macro block type "Macro Block Type" is an intra 
coded block and not forced refresh block "not refresh block". 

Here, the macro block type "Macro Block Type" is, as shown in FIG. 8, represented by the bit 2, the bit 1 

15 and the bit 0 of the flag data "FLAGS" contained in the header data HD4 given from the threshold control unit 
35 to the quantization control unit 36. When these bits are "01 0', the macro block type is an intra coding type. 
When "000", the macro block type is an inter coding type. When "001", the macro block type is a motion com- 
pensated not filtered type "MC-not filtered". When "101", the macro block type is a motion compensated filtered 
type "MC filtered". 

20 When in the step SP5, an affirmative result is obtained, the flag data "FLAGS" is "000" at the bit 2, the bit 

1 and the bit 0 thereof and the forced refreshing flag "refresh" at the bit 4 is in the state of logic "0". 

Such a state means that the current frame has been greatly changed from the previous frame to such a 

degree that the macro block type 'Macro Block Type" needs to be intra coded. Moreover, the current state is 

under the condition such that the forced refreshing mode Is not specified. 
25 If under such conditions, quantization is carried out at a fine quantization step size in the quantizer 37, the 

amount of data of the quantized picture data S39 generated from the quantizer 37 becomes extremely large, 

and hence it is liable that the transmission buffer memory 32 overflows eventually. 

In this event, the quantization control unit 36 goes to the step SP6, where the quantization step size QNT 

is set to the upper limit QNT = 31 . Thus, a processing to restrain the amount of data of the quantized picture 
30 data S39 generated from the quantizer 37 is executed, so that overflowing of the transmission buffer memory 

32 is previously avoided. 

On the contrary, a negative result is obtained In the step SP5, this means that the object to be projected 
Is not an intra coding type or is an intra coding type and generated as the result of forced refreshing. In this 
case, the quantization control unit 36 does not perform the procedure of the step SP6 but jump this step. 
35 (2-3) Processing in the forced refreshing mode 

Subsequently, in the step SP7 the quantization control unit 36 makes a judgement as to whether or not 
the macro block to be processed is a forced refreshing type block. 

When an affirmative result is obtained in this step, this tells that it is indicated that forced refreshing should 
be achieved. In this case, the quantization control unit 36 proceeds to the step SP8, where the previous frame 
40 quantization step size PQNT which has been used as quantization step size QNT in the previous quantization 
is set Thus, quantization is carried out at the same quantization step size as in the previous frame when it is 
indicated that the forced refreshing should be executed. 

This enables the quality of the picture not to change to such as degree that it provides an eye-sore in effect 
when the forced refreshing is performed. 
45 The forced refreshing is executed in a predetermined cycle irrespective of the contents of the picture, and 
hence the quantization step size changes as compared to that of the previous frame even though the contents 
of the picture does not change. This can provides an eye-sore in many cases. 

If the quantization step size is not changed when the forced refreshing is Indicated, It is possible not to 
produce any change of the picture which provides an eye-sore in the refreshing, 
so It is to be noted that the same effect as described above can be achieved by selecting a smaller value in 
place of using the same value as the previous quantization step size. 

A reproduced picture is degraded In quality by enlarging the quantization step size when the forced ref- 
reshing is indicated without any change in the picture. On the contrary, slight reduction of th quantization step 
size somewhat improves the reproduced plctur in quality, and th reby it is possible that any change of picture 
55 does not come to one's notice in effect 

When in th step SP7 a negativ result is obtained, this m ans that the forced refreshing is not currently 
indicated. In this case, the quantizer 37 d es not performs any procedur in the step SP8 but jumps the stBp. 
(2-4) Processing in a case where the diff rential data is large in power 
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Subsequently, in the step SP9 the quantization control unit 36 judges wheth r or not the macro block type 
is th inter coding type and the macro block power MBP is larger than a pred termined threshold Threshold". 
Here, the macro block power MBP is defin d as: 



MBP = £ (Cocf t { . . . ( i > 

i« I 

10 When an affirmative result in obtained in the step SP9, this means that it is in a state that there is produced 
any change such that a reproduced picture does not extremely degraded in quality even if the picture data of 
the macro block MB is quantized at a somewhat rough quantization step size and then transmitted, since the 
picture data, that is, the macro block power MBP of the differential data is large. 

When a macro block which meets such conditions is discrete cosine transformed in the transform coding 
is circuit 29, the quantization control unit 36 confirms this in the step SP9 and proceeds to the step SP1 0, where 
it sets the quantization step size QNT to the most rough value, that is, the upper limit QNT = 31. 

When transform code data S35 of a macro block with a macro block power MBP not so large as this is 
sent, the quantization control unit 36 jumps the step SP10 not to perform the process of the latter. 

The macro block power MBP defined by the equation (1) aims to operate weight of each macro block on 
20 the basis of the discrete cosine transform coefficient Coefffj) which is obtained as a result of the discrete cosine 
transformation in the transform coding circuit 29. The weight of the discrete cosine transform coefficient rep- 
resents intensity of a transmission signal which has been obtained by the discrete cosine transformation. A 
large macro block power MBP thus means that the intensity of the transmission signal as signal transmission 
means is large, and hence even if the transmission signal is sent with some compression, the transmitted infor- 
25 mation can be reconstructed in a receiving end without being influenced with external noises. 

In such a case, the quantization control unit 36 compressed the amount of the quantized picture data S39, 
which is generated in the quantizer 37, by changing the quantization step size QNT to a larger value, and 
thereby reducing a load to the transmission line 43. 

Incidentally, the discrete cosine transform circuit which constitutes the transform coding circuit 29 performs 
30 discrete cosine transformation according to the following equation; 



F(u, v) 
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The inverse discrete cosine transform circuit which constitutes the inverse transform coding circuit 56 performs 
50 inverse discrete cosine transformation according to the following equation: 
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where x and y represent coordinates of pixels in the macro block (the upper left comer has a coordinate (0, 0); 
and u and v represent coordinates of coefficients in the discrete cosine transformation. 
When u and v equal zero, 

20 C<u)C(v) = -k (4) 

and in the other cases, 

C(u)C(v)=1 (5) 

Suppose that X is a picture data matrix in a macro block and C is a transform matrix when discrete cosine 

25 transformation is carried out, In the transformation of each of the equation (2) and (3) In the transform coding 
circuit 29 a picture data matrix X is horizontal transformed to produce a transformed picture data matrix XC- 1 , 
and then undergoes vertical transformation to obtain a transformed picture data matrix C(X)0 1 . 

The transformed picture data matrix C(X)C- 1 thus obtained Is, as illustrated in FIG. 12, expressed as an 8 
x 8 transformation coefficient matrix including coefficient Coeff(1), Coeff(2) l Coeff(3), ... and Coeff(64), and 

30 each coefficient Coeff(i) (i = 1 to 64) of the transform coefficient matrix is read from the transform matrix by 
scanning in the order of I = 1, 2, 3, ... 64 as the lapse of time. 

Thus, the picture data of a one macro block is transformed to transform coefficients Coefffl) (i = 1 to 64) 
which constitutes the transform matrix, and these transform coefficients are fed as transmission data arranged 
in series in time to the quantizer 37. 

35 Thus, the transform coefficient data series Coeff(1 ), Coeff(2), ... and Coeff(64) fed to the quantizer 37 rep- 
resent not only information to be sent but intensity of signals to be transmitted. As defined by the equation (1), 
the sum of squares of transform coefficient data (i = 1 to n) contained in the transform coefficient data series 
Coeff(i) (1 = 1,2, ... 64) is a value obtained by accumulating so that signals to be sent becomes horizontally 
and vertically equal in intensity. Thus, the equation (1) defines this as the macro block power MBP. 

40 When the transform coefficient matrix as shown in FIG. 12 is obtained in practice by discrete cosine trans- 
formation of pixel data, there is a tendency that power is concentrated at the transform coefficient Coeff(i) at 
the upper left comer, that is, lower degree transform coefficients whereas significant information is not produced 
in the transform coefficient at the lower right comer, that is, the higher degree transform coefficient. In this man- 
ner, compression of transmission data can be achieved by discrete cosine transformation. 

45 II it is confirmed that a macro block power MBP obtained according to the equation (1) is larger than the 
predetermined threshold Threshold" when It has been judged in the step SP9 of FIG. 9B that the macro block 
type "Macro Block Type" is the inter coding type, this means that the differential data In the macro block MB is 
sufficiently large. It is thus confirmed that rough quantization is sufficient If the quantization step size QNT is 
selected to the upper limit in the step SP10 according to such Judgement, the differential data is transmitted at 

so a relatively small amount. 

(2-5) Processing in the inter coding mode 

When in the step SP1 1 of FIG. 9B, it is confirmed that the macro block type "Macro Block Type" is the Inter 
coding type, and that the macro block pow r MBP is smaller than th predetermined threshold "Threshold", 
the quantization control unit 36 proc ds to the st p SP12. wh r the quantization step size QNT is set to a 

55 1/2 of the previous quantization step siz PQNT used in the previous frame. Then, in the st p SP13 it is judged 
whether rn t th quantization st p size QNT is small rthanth lower limit QNT = 1. When the quantization 
step size QNT is small r, it is reset to th lower limit in the step SP14. When not smaller, th value is set as 
the quantization step size QNT without resetting. 
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Here, as describ d in connection with the equation (1) th macro block power MBP represents the intensity 
f the differential data signal of th macro block, and hence when an affirmative result is obtained in the step 
SP11, the macro block power MBP represents that the difference is small, and that the picture has a small 
change in contents from the previous frame. 
5 When such picture data is obtained, it shows that the picture to be transmitted is in a state that there is 

only a change to such a degree that the picture of the previous frame is partially modified without any great 
change. 

Thus, in the step SP12 the quantization control unit 36 reduces the previous quantization step size PQNT 
of the previous frame to 1/2, which is set as the quantization step size QNT of the current frame. In this manner, 
10 the quantization step size is made finer according to the reduced change for the current frame which is small 
in movement as compared to the previous frame, and the optimum quantization step size can be thus set 

The quantization control unit 36 repeats such reduction of the quantization step size in the steps SP1 1 and 
SP12 while pictures with small motions follow* and hence in a case where transmission of pictures with small 
motions are continued, the quantization step size is converged toward a value to meet this. 
15 Then, in the steps SP13 and SP14 the quantization step size QNT is controlled not to be smaller than 1. 
and in a case where pictures with small motions are sent the quantization control unit 36 can thereby stably 
perform quantization in a state in which the quantization step size QNT is converged to the lower limit. 

In a case where a negative result Is obtained in the step SP1 1 , the quantization control unit 36 judges that 
the picture to be sent currently is large in change, and does not performs and jumps the procedures in the steps 
20 SP12,SP13andSP14. 

(2-6) The operation of the quantization control unit 36 

In the first case where the data residual amount "Buffer" of the transmission buffer memory 32 exceeds 
the upper limit (QCF + Margin), the quantization control unit 36 detects this in the step SP1 and sets the quan- 
tization step size QNT of the quantizer 37 to the upper limit QNT = 31 in the step SP2, so that the data residual 
25 amount "Buffer" of the transmission buffer memory 32 is reduced to thereby keep in a state below the upper 
limit thereof. 

In the second case where in this state, block data of which macro block type "Macro Block Type" Is the 
intra coding type and which is not a forced refreshing type is provided to the quantizer 37, the quantization con- 
trol unit 36 confirms this in the step SP5 and sets the quantization step size QNT of the quantizer 37 to the 

30 upper limit QNT = 31 in the step SP6 so that the transmission buffer memory 32 does not overflow. 

When negative results are obtained in respective steps SP7, SP9 and SP11 in such an operation mode, 
the quantization control unit 36 sets the quantization step size which has been set in the step SP6 as previous 
frame quantization step size PQNT in the step SP3 and then completes the routine. 

In the third case where macro block data having the forced refreshing block type is provided to the quantizer 

35 37, in the quantization step size determining routine RTO the quantization control unit 36 confirms this by the 
loop of the steps SP1-SP5-SP7. The quantization control unit 36 sets the previous frame quantization step size 
PQNT as the quantization step size QNT of the quantizer 37 in the step SP6 and thereby controls the picture 
to be sent not to change in quality from the picture of the previous frame in the forced refreshing mode so that 
any change in quality which provides an eye-sore is not produced in the forced refreshing. 

40 In this case, the quantization control unit 36 obtains negative results in respective steps SP9 and SP11, 
and thus the quantization step size QNT which has been set in the step SP6 is set as the previous frame quan- 
tization step size PQNT in the step SP3 and then completes the routine. 

in the fourth case where picture data of a macro block with a large macro block power MBP is provided to 
the quantizer 37, in the quantization step size determining routine RTO the quantization control unit 36 confirms 

45 this by the loop of the steps SP 1 -SP5-S P7-SP9. Then, the quantization control unit 36 sets the quantization 
step size QNT of the quantizer 37 to the upper limit QNT = 31 , and thereby holds the amount of data generated 
in the quantizer 37 at a small value. This enables the picture data to be transmitted with much improved effi- 
ciency. 

After such procedures, the quantization control unit 36 obtains a negative result in the step SP1 1 and thus 
so resets the quantization step size QNT, which has been set in the step SP10, as the previous frame quantization 
step size PQNT in the step SP3. Then, the routine is completed. 

In th fifth cas wher macro block data which is of the inter coding type with a small macro block pow r 
MBP is fed t the quantizer 37, in the quantization st p size determining routine RTO the quantization control 
unit 36 confirms this by the loop of the steps SP1-SP5-SP7-SP9-SP11. Th n, In the step SP12 th value of 
55 1/2 of the previous frame quantization step siz PQNT is set as the quantization step size QNT and thereby 
the quantization step size is conv rged toward the lower limit QNT = 1. 

Thus, th quantization step siz which is most suitably applied to the macro block power MBP can be set 



14 



EP 0 444 839 A2 



(3) Modifications of the first embodiment 

(3-1) Although it is stated that the quantization step size QNT is set to the upper limit QNT = 31 in the steps 
SP6 and SP10 in FIGS. 9A and 9B t the quantization step size QNT is not limited to that upper limit and may 
5 be set to other values. It is essential that a rough quantization value which enables rough quantization is selec- 
ted. 

(3-2) It is described that the same threshold Threshold" is selected forjudging the magnitude of the macro 
block power MBP in the steps SP9 and SP1 1 of FIG. 9B. By selecting a different value in place of this, an effect 
similar to the case above described can be achieved. 

10 (3-3) It Is further described that in determining the quantization step size QNT from the previous frame quan- 
tization step size PQNT in the step SP12 in FIG. 9B, a value of 1/2 thereof is set. The ratio Is not restricted to 
1/2 by may be changed to different values according to needs. It is essential that the quantization step size is 
set to a size which is obtained by reducing the previous frame quantization step size at a predetermined ratio. 
(3-4) It is stated that the quantization step size QNT is converged toward the lower limit QNT = 1 in the steps 

15 SP13 and SP14 of FIG. 9B. However, the convergence value is not limited to that lower limit but may be set 
to different values according to needs. 

(4) Frame Dropping in the Embodiment 

20 In the picture information transmission system 21 shown In FIGS. 4A and 4B, the transmission buffer mem- 
ory 32 feeds back the residual amount data S32 representing data residual amount "Buffer" to the quantization 
control unit 36, and thereby the transmission buffer memory 32 is controlled not to overflow or underflow data 
by changing the quantization size data QNT in the quantization of the quantizer 37. 

More specifically, In the second embodiment the quantizer 37 is as shown in FIG. 13 variable in steps, as 

25 a table of the quantization size data QNT, from an upper limit QNT = 31 to a lower limit QNT = 1. In a case 
where the data residual amount •Buffer* of the transmission buffer memory 32 approaches the sum of the mar- 
gin "Margin" and the quantization size controllable range QCR (the permissible upper limit of the data residual 
amount), the QNT is roughened (that is, changed toward QNT = 31). 

Accordingly, the amount of data of the quantized picture data S39 is controlled to a small value by carrying 

30 out quantization of the transformation code data S35 with the rough quantization step size, and thereby the 
data residual amount "Buffer" of the transmission buffer memory 32 decreases. 

On the contrary, when the data residual amount of the transmission buffer memory 32 becomes small, the 
quantization control unit 36 changes the QNT to a fine value (that is, toward QNT = 1 ) according to this decrease, 
and thereby controls the data residual amount "Buffer" of the transmission buffer memory 32 to converge to a 

35 level of a desired value MG (QNT = 1) always. 

The residual amount data S32 fed back from the transmission buffer memory 32 is inputted to the filter con- 
trol unit 31, and thereby the filter control unit 31 judges whether or not frame dropping is executed in the unit 
of a field, always monitoring the data residual amount "Buffer* of the transmission buffer memory 32. 

More specifically, the filter control unit 31 judges that the transmission buffer memory 32 comes close to 

40 an overflow state at a time t, (FIG. 13) when the amount of generation of the transformation code data S35 
increases and exceeds the upper limit (margin "Margin" + quantization size controllable range QCR) over which 
the data residual amount "Buffer" of the transmission buffer memory 32 is not controllable by the quantizer 37. 
The filter control unit 31 thus sets the drop frame flag "Drop frame flag " (FIG. 8) to "1"; the drop frame flag is 
contained in flag data "FLAGS" of second header data HD2 of each macro block MB corresponding to one field 

45 of pixel data of the subsequent third frame FRM2. This drop frame flag is successively transferred to the third 
header data HD3, HD4 and HD5. and is thereby sent to the variable length coding circuit 38 and the inverse 
quantizer 40. 

In a case where the drop frame flag "Drop frame flag* which is contained in the flag data "FLAGS" of the 
header data HD5 inputted to the variable length coding circuit 38 Is set to M 1". the variable length coding circuit 
so 38 does not send the transmission picture data S40 by not variable length coding the quantized picture data 
S39. 

In this manner, the threshold control unit 35 sets the drop frame flag "Drop frame flag" to "1" about every 
macro bl ck MB of th second frame FRM2, and thereby the frame FRM2 is frame dropped by controlling the 
variable I ngth coding circuit 38 not to send the transmission picture data S40 of every macro block MB of the 
55 frame FRM2. 

Thus, in the transmission buffer memory 32 at a state in which the data residual amount "Buffer" exceeds 
th upper limit, th data residual amount "Buffer" decreases by data utputt dtoth transmission line 43 since 
the one frame of data is not inputted. 
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On the other hand, the inverse quantizer 40 does not inverse quantize quantized picture data S39 inputted 
to correspond to header data HDS when the drop frame flag "Dr p frame flag" of the header data H05 inputted 
is set to "1*, and thereby the voice data generator 42 is not transmitted. 

Accordingly, every macro block MB of one frame of the frame FRM2 to which is indicated frame dropping 
5 is not outputted as the inverse quantization data S42. so that the data of the frame FRM2 is frame dropped 
from predicted previous frame data which is to be newly stored in the predicted previous frame memory 27. 

Thus, also in the predicted previous fram data the pixel data undergoes frame dropping through the trans- 
mission buffer memory 32 to correspond to the frame dropping of the pixel data outputted. 

After starting the indication of frame dropping according to the data residual amount "Buffer" of the trans- 
10 mission buffer memory 32, the filter control unit 31 continues to indicate the frame dropping until the data resi- 
dual amount "Buffer" decreases below the desired residual value MG. 

Accordingly, the frame dropping is continued even when the data residual amount "Buffer" of the transmis- 
sion buffer memory 32 drops below the upper limit at time t 2 (FIG. 1 3). When the data residual amount "Buffer" 
is below the desired value MG in a fourth frame FRM4 at time ta, the transmission buffer memory 32 detects 
15 this, and sets the drop frame flag "Drop frame flag" of header data, corresponding to the subsequent frame 
FRM5, to "0" after the indication of the frame dropping of every macro block MB of the frame FRM4 on which 
frame dropping is executed is completed. Thus, variable length coding of quantized picture data S39 is restarted 
in the frame picture data FRM. 

Accordingly, the data residual amount "Buffer" of the transmission buffer memory 32 changes depending 
20 on the amount of inputted and outputted data by inputting data from the transmission picture data S40 of this 
frame FRM5 to the transmission buffer memory 32 again. 

Thus, the transmission buffer memory 32 resets the drop frame flag "Drop frame flag" which corresponds 
to every macro block MB in the unit of a frame to "0" unless the data residual amount "Buffer" exceeds the upper 
limit again, so that transmission picture data S40 is inputted to the transmission buffer memory 32 and the data 
25 residual amount "Buffer" changes accordingly. 

Even if the amount of generation of the transmission picture data S40 rapidly increases as in the previous 
state before the frame dropping was executed, frame dropping is not restarted at once since in the transmission 
buffer memory 32 the data residual amount "Buffer" has been reduced to the desired value MG. 

Thus, a state in which transmitted frames and not-transmitted frames are repeated every other frame is 
30 avoided, and hence video images which are obtained by reproducing pixel data outputted from the transmission 
buffer memory 32 are not deteriorated in smoothness of visual movement 

Because the data residual amount "Buffer" is reduced to the desired value MG (QNT = 1) by frame dropping, 
the data residual amount "Buffer" can be converged at the desired value MG (QNT = 1) in much shorter time 
in a case where the amount of generation of the transmission picture data S40 is reduced in the subsequent 
35 frame FRM6, for example. In this case, the data residual amount "Buffer" has not yet increased to the upper 
limit. 

When a swift picture (that is, a picture with a large transmission picture data amount) is rapidly changed 
to a slow picture (that is, a picture with a small transmission picture data amount), the quantization step is con- 
trolled to a fine one (QNT = 1) in a short time, and thereby fine picture expression can be given at once when 
40 the movement of the picture becomes slow. 

It is to be noted that a swift picture cannot be recognized as visual picture being degraded, and that a slow 
picture can be visually sharply recognized to fine portions thereof. The deterioration of picture quality can be 
visually avoided by changing the quantization step size to a fine one at once when movement of the picture 
becomes slower. 

45 FIG. 14 illustrates an accumulated value TRM of the amount of transmission picture data (that is, variable 
length coded data), inputted to the transmission buffer memory 32, of each frame; FD11 to FD26 designate 
the amount of transmission picture data of one frame for frames FRM1 1 to FRM26, respectively. 

When in the frame FRM 1 6, for example, a transmission picture data amount FD 16 of one frame is inputted 
and the data residual amount "Buffer" exceeds the upper limit (QNT = 31), frame dropping is started simul- 

50 taneously with the completion of inputting of all the data of the frame FRM16, and thereby the data residual 
amount "Buffer relatively reduces. 

As a result, the data r sidual amount "Buffer" of the transmission buff r memory 32 reduces below the des- 
ired value MG (QNT = 1) before transmission picture data FD1 7 of a frame FRM 1 7 is inputted, and hence input- 
ting of the transmission pictur data of the frame FRM 17 is started. 

55 In this ev nt, there may b a case where the transmission picture data amount FD1 7, FD1 8, FD19 of ach 

of the subsequent frames FRM 1 7, FRM1 8 and FRM1 9 is small and the data residual amount "Buff r" of the 
transmission buffer memory 32 is below an und rfiow level UNDER before transmission picture data of a frame 
FRM20 is inputt d. In such a case, stuffing bits are inserted between the data before th "Buffer" becomes 
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below the underflow level UNDER s that the transmission buffer memory 32 may not underflow. 

Thus, in the transmission buffer memory 32 frame dropping and stuffing bit inserting technique are used 
so that the data residual amount 'Buff r" may be overflow or underflow, and thereby the data residual amount 
"Buffer" is controlled to converge to the desired value (QNT = 1) as closely as possible. 
5 According to the construction above, frame dropping Is carried out to converge the data residual amount 
"Buffer" of the transmission buffer memory 32 to desired value MG (QNT = 1), and thus in reproduction of the 
output data of the transmission buffer memory 32, video images with visually much smooth movement can be 
obtained and degradation in picture quality can be avoided. 

10 (5) Modifications of the second embodiment 

(5-1) Although in the second embodiment above described, it is stated that the desired value MG (QNT = 1) is 
used as the detection level of the end of the frame dropping, but the present invention is not limited to this. For 
example, the macro block MB may be modified to other levels within the quantization size controllable range 
15 QCR, depending on the tendency of the amount of generation of transmission picture data according to swift 
video images or slow video images. 

(5-2) Furthermore, in the above embodiment it is described that the indication of frame dropping is carried out 
in the filter control unit 31 by detecting the data residual amount "Buffer" of the transmission buffer memory 
32, but the present invention is not limited to this. The detection and the indication may be performed in other 

20 data processing units provided in previous stages of the transmission buffer memory 32. 

(5-3) In the above embodiment, there is described a case where the frame dropping is executed in the variable 
length coding circuit 38, but the present invention is not restricted to this. It is essential that the frame dropping 
is performed in steps previous to the transmission buffer memory 32. For example, in the quantizer 37, frame 
dropping may be carried out by detecting the frame dropping indication of the header data. 

25 (5-4) In the embodiment above described, it is stated that the present invention is applied to the picture infor- 
mation transmission system which transmits voice signals and video signals. The present invention is not limited 
to this and may be widely applied to cases such as a case in which video signals undergo high efficiency coding 
and are then transmitted. 

30 (6) The third embodiment 

(6-1) Construction of the third embodiment 

In FIG. 15, 65 generally designates a videophone system of the third embodiment of present invention, 
which transmits pictures and voices of communicators to and from a destination. 
35 The video signal transmission system 65 takes a picture of a speaker through a television camera 66, and 
the video signals Sy outputted from the television camera 66 are provided to a video signal processing circuit 
67. 

The video signal processing circuit 67 converts the video signals S v to luminance signals and chrominance 
signals, which are then converted to digital signals in an analog to digital conversion circuit. 

40 Moreover, the video signal processing circuit 67 converts the luminance signals and the chrominance sig- 
nals which have been converted to digital signals to signals in a format according to CCITT (International Tele- 
graph and Telephone Consultative Committee). 

More specifically, after the frame frequency is converted to 15 Hz by thinning video signals for every pre- 
determined frames, the number of pixels in vertical and horizontal scanning directions is reduced. 

45 In this manner, with respect to the luminance signals input video signals are constructed having consecutive 

picture data D )N with 352(horizontal) x 288(vertical) pixels (that is, CIF picture size) or 176 x 144 pixels (QCIF 
picture size). 

Thus, the amount of data is reduced by applying the preliminary processing to the video signals Sy through 
the video signal processing circuit 67, and thereby the input video signals having consecutive picture data Dm 
50 in the order of the line scanning are obtained. 

As shown in FIG. 1 5, a motion vector detection circuit 68 temporarily stores the picture data D w in a memory 
circuit in a scan conversion circuit incorporated therein, and then reorders the array of the picture data D^ by 
s quentially reading in a predetermined order. 

More sp ciflcally, the motion vector d t ction circuit 66 separates one frame f a picture into 2x6 block 
55 groups GOB in horizontal and vertical canning directions, respectiv ly (FIG. 6). 

Furthermore, the motion vector detection circuit 68 separat s each block gr up GOB into 11 x 3 macro 
blocks MB, and then separates each macro block MB into data blocks DB in the unit of 8 x 8 pixels in the hori- 
zontal and v rtical scanning directions, respectively (FIG. 6). 
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Thus, in the video signal processing unit, picture data is transferred and processes in the unit of a block 
group GOB. 

In th array of the pictur data D IN within each block group GOB, picture data D, N are consecutively arranged 
in the unit of a macro block MB; within each macro block MB picture data D, N are consecutively arranged in 
5 the unit of a data block DB in the order of the raster scanning. 

In each macro block MB, 8x8 pixels of picture block data (Yqo, Y^, Y 10 and Y n ) which are consecutive in 
the horizontal and vertical scanning directions are provided as a unit to the luminance signal whereas in the 
video signal processing circuit 67 the two chrominance signals are reduced in the amount of data and are then 
time-multiplexed and 16 x 16 pixels of data is allotted to respective data blocks OB(C r , C B ). 
10 In this event, the motion vector detection circuit 68 detects a motion vector for each macro block MB by 
setting a picture of the immediately previous frame which has been reconstructed in a decoder circuit 69 as 
the reference frame. 

Furthermore, the motion vector detection circuit 68 moves the picture of the reference frame by the detected 
motion vectors and constructs picture data of 16 x 16 pixels at positions corresponding to macro blocks MB of 
15 the current frame. Then, the motion vector detection circuit 68 outputs the picture data Dm to a differential data 
construction circuit 70. 

Simultaneously, the motion vector detection circuit 68 outputs the picture data Djnd, of which array has been 
rearranged, with a delay necessary for detecting motion vectors. 

Moreover, the motion vector detection circuit 68 generates a header D HET on the basis of the number of 
20 the frame of the picture data D,^, address data of the block group and the macro block, motion vector Dug, 
and a sum of an absolute value obtained in detection of the motion vector and outputs the header to the diffe- 
rential data construction circuit 70. 

The differential data construction circuit 70 outputs picture data D, ND for every predetermined frames to a 
subsequent discrete cosine transform circuit 71 without processing it, so that intra coded picture data is trans- 
25 mitted to a transmission destination at predetermined time intervals. 

Regarding frames other than frames intra coded, picture data Dpp, is subtracted from the picture data D,^, 
and the resultant differential data D z is outputted to the discrete cosine transform circuit 71. 

In the video signal transmission system 65, picture data is thus inter coded by sending the differential data 
D z , and intra and inter coding operations are switched at a predetermined cycle. In this manner, the input video 
30 signals are efficiently transmitted to a destination. 

In this event, the differential data construction circuit 70 suppresses a high frequency component of the 
picture data D pra with a loop filter circuit according to needs when the picture data Drrj is subtracted from the 
picture data D lND . 

This makes the boundaries between macro blocks MB unobtrusive when differential data D z is coded by 
35 detecting the motion vector in the unit of a macro block MB. 

Moreover, the differential data construction circuit 70 detects the amount of data necessary for transmission 
in the unit of a macro block MB. When the differential data construction circuit 70 judges that the macro block 
MB can be transmitted at a small amount of data by intra coding as compared to inter coding, even a macro 
block MB of a frame to be inter coded is outputted to the following discrete cosine transform circuit 71 without 
40 performing any operation on the picture data D IND as in the macro block MB of a frame intra coded and then 
sent 

In the video signal transmission system 65, a high frequency component of motion vector D UQ is suppressed 
according to the amount of data necessary for transmission when the inter coding is performed, and the intra 
coding operation may be switched from the inter frame operation. In this manner, the video signals are efficiently 
45 sent using the technique of the selective prediction. 

Simultaneously, the differential data construction circuit 70 remove data of the absolute sum from the 
header D H et sent from the motion vector detection circuit 68, and then adds discrimination data of the inter cod- 
ing and intra coding and discrimination data as to whether or not the differential data is obtained through the 
loop filter circuit for outputting to the discrete cosine transform circuit 71. 
so The discrete cosine transform circuit 71 discrete cosine transforms the picture data D IN0 and the differential 
data D z , which have been outputted from the differentia) data construction circuit 70, in the unit of a macro block 
MB, using a two dimensional autocorrelation between video signals. The resulting transformed data Didct is 
outputted to a quantiz r72. 

In this event, the discrete cosine transform circuit 71 adds data, such as accumulated code I ngth of the 
55 transformed data Dqct, t th h ader sent from the differential data construction circuit 70 and th n output it 
The quantizer 72 quantizes and then utputs the transf rm d data Dqct* 

In this event, th quantizer 72 d t cts the accumulated code length and the amount f data of th trans- 
formed data Didct according to th header outputted from the discrete cosine transform circuit 71, and at th 



18 



EP 0 444 839 A2 

same time detects a residual amount of th transmission buffer circuit 73. According to the result of the d tec- 
tion, the quantization step size is changed. 

In this manner, the quantizer 72 keeps the amount of data at a predet rmin d value per each frame t be 
transmitted. 

5 Furthermore, the quantizer 72 deletes data, such as the accumulated code length of the transformed data 

Doct. trom the header outputted from the discrete cosine transform circuit 71 , and then adds data of the quan- 
tization step size to the header for outputting. 

The inverse quantization circuit 74 performs transformation inverse to the quantizer 72 according to the 
header outputted from the quantizer 72, and thereby reconstructs the transformed data Dqct of the differential 
10 data construction circuit 70, which is to be reproduced in the transmission destination, at the transmission end. 
On the other hand, the inverse discrete cosine transform circuit 75 executes a transformation operation 
inverse to the discrete cosine transform circuit 71 according to the header sent through the inverse quantization 
circuit 74. 

Thus, in the video signal transmission system 65, the input data of the discrete cosine transform circuit 71 
15 which is reconstructed in the destination is reproduced in the transmission end. 

More specifically, through the inverse discrete cosine transform circuit 75, the picture data Dind can be 
reconstructed on video signals intra coded and transmitted whereas the differential data D z can be reproduced 
on video signals inter coded and sent 

A decoder circuit 69 is composed of a frame memory circuit and an adder circuit, and the operation thereof 
20 is switched according to the header transmitted through the inverse discrete cosine transform circuit 75. 

More specifically, when Intra coded data (that is, picture data which reconstructs the picture data D 1ND ) is 
outputted from the inverse discrete cosine transform circuit 75, the decoder circuit 69 directly stores the picture 
data to the frame memory circuit. 

The picture data Dsv stored in the frame memory circuit is outputted to the motion vector detection circuit 
25 68 at the timing of inputting picture data D, N of the next frame to the motion vector detection circuit 68. 

In this manner. In the motion vector detection circuit 68 a motion vector of the frame subsequent to the 
intra coded frame can be detected on that intra coded frame as the reference frame. 

When inter coded data (that is, data which reconstructs the differential data DJ is outputted from the inverse 
discrete cosine transform circuit 75, the decoder circuit 69 shifts the picture data Dsv stored In the frame memory 
30 circuit by the motion vector of the differential data D 2 , and then adds the shifted picture data to the differential 
data D z . The resultant data is stored in the frame memory circuit 

Thus, the original picture data of the frame interceded can be reconstructed. In this manner, pictures sent 
to the destination are sequentially reconstructed and stored in the frame memory circuit 

Furthermore, The decoder circuit 69 outputs the picture data D sv stored in the frame memory circuit to the 
35 motion vector detection circuit 68 at the timing of inputting picture data D, N of the next frame to the motion vector 
detection circuit 68. 

This enables motion vectors of current frames to be sequentially detected on the basis of respective 
immediately previous frames in the motion vector detection circuit 68. 

In this event, in the decoder circuit 69, a high frequency component of the differential data D z which has 
40 been produced through the loop filter circuit is suppressed by means of the loop filter circuit and the differential 
data Dj is shifted by the motion vector. Thus, the loop titer circuit is changed in relation to the differential data 
construction circuit 70 so that the boundaries between macro blocks MB are not unobtrusive. 

A variable length coding circuit 76 applies variable length processing to the output data of the quantizer 
72 together with data, such as the motion vector, the output data being obtained through the buffer circuit 77. 
45 Then, the variable length coding circuit 76 outputs the resultant data to the transmission buffer circuit 73 
together with the header. 

The transmission buffer circuit 73 temporarily stores and then sequentially outputs the output data of the 
variable length coding circuit 76. 

A stuff bit adding circuit 78 outputs the output data of the transmission buffer circuit 73 to a error correction 
50 circuit 79. In this event, the stuff bit adding circuit 78 detects the amount of input/output data of the transmission 
buffer circuit 73. When the amount of input data of the transmission buffer circuit 73 becomes extremely small 
as compared to a transmission rate of the line L1, the stuff bit adding circuit 78 inserts stuff bits in data at pre- 
determined timings. 

The error correction circuit 79 generates a BCH code (bose chaudhuri h cquenghem code) according to 
55 the output data of the stuff bit adding circuit 78. The error correction circuit 79 adds th cod t the utputdata 
from the stuff bit adding circuit 78 and outputs the resulting data. 

Furthermore, the error correction circuit 79 performs error correction on data obtained from the destinati n 
through a multiplex conv rsion circuit 80 according to the BCH code transmitted by adding t the data, and 
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thereby degradation in picture quality is effectively av Wed if an error or nrors occur during transmission. 

Th multiplex conversion circuit 80 multiplexes digital voice signals to the output data of the error correcti n 
circuit 79 and then outputs the resulting signals to the line L1. 

This enables video signals Sy and voice signals to be efficiently sent to the transmission destination. 
5 Simultaneously, the multiplex conversion circuit 80 inputs data transmitted from the destination through 

the line L1, and separates multiplexed video and digital voice signals. 

Furthermore, the multiplex conversion circuit 80 outputs separated digital voice signals to a predetermined 
decoding circuit, and outputs the video signals to a stuff bit removing circuit 81. 

The stuff bit removing circuit 81 removes the stuff bits which have been inserted in the stuff bit adding circuit 
10 78 at the destination. 

A buffer circuit 82 temporarily stores the stuff bits removed data, and then outputs it to a decoding circuit 
83 after the header is separated. 

The decoding circuit 83 performs a processing inverse to the processing of the variable length coding circuit 
76 at the destination. 

15 An inverse quantization circuit 84 performs inverse quantization on the output data of the decoding circuit 
83 according to the header inputted through the decoding circuit 83, and thereby reconstructs the input data 
inverse quantized of the quantizer 72 at the destination. 

Similarly with the inverse discrete cosine transform circuit 75, an inverse discrete cosine transform circuit 
85 processes the output data of the inverse quantization circuit 84 according to the header, and thereby recorv 
20 structs data discrete cosine transformed at the destination. 

A decoder circuit 86 performs an operation similar to the operation of the decoder circuit 69 according to 
the header transmitted, and thus picture data encoded at the destination is reconstructed. 

A video signal processing circuit 87 executes an operation inverse to the operation of the video signal pro- 
cessing circuit 67 by a technique of interpolate operation, and then outputs the resulting video signals to a mon i- 
25 tor 88, so that a picture to be communicated which has been sent from the destination can be monitored. 
(6-2) Differential data producing circuit 

As show in FIG. 16, the differential data construction circuit 70 inputs picture data D,kd outputted from the 
motion vector detection circuit 68, to a switch circuit 91 through a buffer memory circuit 92. 

Thus, the differential data construction circuit 70 outputs picture data D iKD to the subsequent discrete cosine 
30 transform circuit 71 through the switch circuit 91 andthe buffer memory circuit 93 when video signals intra coded 
are sent. 

An arithmetic and logic circuit 94 of a subtraction circuit configuration subtracts picture data Dpr, from pic- 
ture data D tND to produce differential data D zv which is outputted to a switch circuit 95 through a buffer memory 
circuit 96. 

35 Thus, the differential data construction circuit 70 outputs differential data D z to the subsequent discrete 
cosine transform circuit 71 by switching contacts of the switch circuits 91 and 95 when inter coded video signals 
are transmitted. 

An arithmetic and logic circuit 97 of a subtraction circuit configuration accepts picture data Dp*, through a 
loop filter circuit 98 to subtract the picture data D PRJ from the picture data D IN0 to produce differential data D^. 

40 Furthermore, the arithmetic and logic circuit 97 outputs the differential data to the switch circuit 95 
through the buffer memory circuit 99, and the contact of the switch circuit 95 is switched so that the differential 
data Dpz may be outputted to the discrete cosine transform circuit 71 in place of the differential data D z . 

As shown in FIG. 17, the loop filter circuit 98 has delay circuits 101A and 101B connected in series and 
provides picture data Dpp, to the delay circuit 101 A. 

45 As illustrated in FIG. 18, the delay circuits 101A and 101B are each built by connecting eight stages of 
flip-flop circuit which operate according to the clock frequency of the picture data D PRJ . Thus, picture data D PR | 
which is sequentially inputted at the timing of raster scanning is delayed in the unit of each data block for the 
time interval of one horizontal scanning of the data block. 

Accordingly, in input data D PRJ of the delay circuit 1 01 A and output data of delay circuit 1 01 B, picture data 

so Dprj (hereinafter referred to as picture data of the next line and the previous line, respectively) of pixels which 
are adjacent to output data of the delay circuit 101 A (hereinafter referred to as picture data of a current line) 
in the vertical scanning direction and in a direct! n revers to the vertical scanning direction is sequentially 
arranged. 

In a selection circuit 102A, picture data D PR1 of the current line and the next line are inputted to contacts 
55 P1 and 92 whereas in a s lection circuit 1 02B picture data of th current line and the previous lin to con- 
tacts P1 and P2. 

Furthermore, the selection circuits 102A and 102B switch their c ntacts acc rding to switch signals SEL1 
and SEL2 outputted from a contr I circuit 103, and selection utputs thereof ar adder in an adder 104. 
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More specifically, as shown In FIGS. 19 and 20. the selection circuits 102A and 102B select contacts P1 
during the time interval in which the picture data Dp*, of the first line AR1 , AR2 and AR3 and the last line AR7, 
AR8 and AR9 of a data block DB is utputted from the delay circuit 1 01 A 

Thus, doubly weighted picture data Dpr, (designated by Ao,o) of the current fine can be obtained through 
5 the adder 104 during the time interval. 

On the other hand, the selection circuits 102A and 102B select contacts P2 while picture data D PR j of the 
remaining regions AR4, AR5 and AR6 are outputted from the delay circuit 101A. 

In this manner, addition data (A^i + A^i) of picture data D pra (designated by Ao f i, A^i, respectively) of the 
next line and the previous line can be obtained through the adder 104 during this time interval. 
10 A multiplier 105 doubles picture data Dpr, of the current line, and then adds the resulting data to output 
data D v of the adder 104 at a adder 106. 

Thus, in output data D vo of the adder 106, quadrupty weighted picture data 4A<u> is obtained during the time 
interval in which the picture data Dp*, of the regions AR1 , AR2, AR3, AR7, AR8 and AR9 is outputted from the 
delay circuit 101 A. 

15 On the other hand, addition data (Ao r1 + 2A 0t0 + Ao.i) obtained by adding the doubly weighted picture data 
Ao, 0 of the current line to the addition data (Ao,-i + A0.1) is obtained during the time interval in which the picture 
data Dp Rl of the remaining regions AR4, AR5 and AR6 are outputted from the delay circuit 101 A. 

Delay circuits 1 07A, 1 07B and 1 07C consist of flip-flop circuit actuated by the clock frequency of the picture 
data D PR |, respectively, and are connected in series, in which state output data D vo of the adder 106 is inputted 

20 to one end thereof. 

Accordingly, picture data Drr, of pixels (hereinafter referred to as picture data of the next pixel and the pre- 
vious pixel and designated by A V1 , A4.1, A. V1 and A w , A41, A 1i1( respectively) which are adjacent to output 
data D PR | of the delay circuit 107B (hereinafter referred to as picture data of current pixel and the picture data 
of the current pixel is designated as A 1|0 , A^o. and A 1a0 among picture data of the previous line, the current line 
25 and the next line) in the horizontal scanning direction and in a direction reverse to the horizontal scanning direc- 
tion is obtained through the delay circuit 107A and the delay circuit 107C. 

In a selection circuit 108A the picture data D PRJ of the current pixel and the next pixel are inputted to contacts 
P1 and P2 while a selection circuit 106B inputs the picture data Drrj of the current pixel and the previous pixel. 

Furthermore, the selection circuits 108A and 108B switch their contacts according to switch signals SEL3 
30 and SEL4 outputted from the control circuit 103, and add their selection outputs at an adder 109. 

More specifically, the selection circuits 108A and 108B select contacts a during the time interval in which 
picture data D pm of the data block DB at the horizontal scanning start positions AR1, AR4 and AR7 and the 
horizontal scanning end positions AR3, AR6 and AR9 are outputted from the delay circuit 107B. 

Thus, eight-fold weighted picture data 8Ao,o of the current pixel is obtained during the time interval of out- 
35 putting picture data Dp R , of the regions AR1, AR3, AR7 and AR8. 

On the other hand, adding data (2Ao t .i + 4Ao.o + 2A0.1) doubly weighting the output data D vo of the adder 
106 is obtained during the time interval of outputting picture data D PR] of the region AR4 and AR6 as picture 
data of the current pixel. 

During the time interval in which picture data Dp^ of the remaining regions AR2, AR5 and AR8 is outputted 
40 as picture data Drr, of the current pixel, the selection circuits 108A and selection circuit 108B select contacts 
P2. 

Thus, quadruply weighted addition data (4A. 1(0 + 4A 1f0 ) of picture data A 1(0 and A 10 of the next and previous 
pixel is obtained through the adder 109 during the time interval of outputting picture data D PR1 of the region AR2 
and AR8 as picture data of the current pixel. 
45 On the other hand, addition data (A V1 + 2A. 1f0 + A. 1tl + A V1 + 2A 1(0 + A 1t1 ) which adds weighted picture 
data surrounding the current pixel is obtained through the adder 1 09 during the time interval of outputting picture 
data Dm, of the regions AR5 as picture data of the current pixel. 

A multiplier 110 dou bles the picture data Ao,o of the current pixel, and then adds the resulting data to output 
data D H of the adder 1 09 at an adder 111. 
so A divider 112 divides output data D H0 of the adder 1 1 1 to 1/16, and outputs the resulting data D PR0 to the 
arithmetic and logic circuit 97(FIG. 16). 

Thus, during the time period in which the picture data D PR) of the regions AR1, AR3, AR7 and AR9 of the 
four comers of the data block DB are outputt d as pictur data of the current pixel, pictur data 16Aq,o of the 
current pixel which has been weighted 16 times through the adder 1 1 1 is obtained(FIG. 17), and is then divided 
55 byth divider 112 to output the pictur data Ao >0 of the current pixel. 

Wh n each pictur data A u to A V1 is arranged to correspond to FIG. 19 as showing in FIGS. 21 and 22, 
3x3 output data of two dimensional filter circuit in which only A0.0 is weighted with a value of 1 can be obtained. 
During a time Interval in which the picture data Dpr, of the regions AR2 and AR8 are outputted as picture 
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data of the current pixel, addition data (4A. 1>0 + 8Ao, 0 + 4A 1(0 ) can be obtain d by weight adding picture data 
A* 1,0, A04 and A 1(0 of the next, the current and the previ us pixels, and can thus be divided by the divider 112 
to produce picture data (A. lt0 + 2^ + A 1#0 )/4. 

Thus, normalized 3x3 output data of the two dimensional filter circuit can be obtained by weight adding 
5 picture data of three horizontally consecutive pixels with values 1 , 2 and 1. 

During the time interval in which the picture data D PR) of the regions AR4 and AR6 are outputted as the 
picture data of the current pixel, addition data (4Ao..i + SAoj + 4Aoj) having the picture data Ao,.i + Ao,o + Ao,i 
of the next, the current and the previous line weight added is obtained, and is thus divided by the divider 1 12 
to produce picture data (A© f1 + 2Ao, 0 + Ao,.i)/4. 
10 Thus, normalized 3x3 output data of the two dimensional filter circuit can be obtained by weight adding 
picture data of three vertically consecutive pixels with values 1, 2 and 1. 

During the time interval in which the picture data Dp^ of the region AR5 is outputted as the picture data of 
the current pixel, addition data (A. V1 + 2A. 1t0 + A. 1(1 + 2A 0 .-i + 4Ao t0 + 2Ao, t + A V1 + 2A 1(0 + A 1(1 ) having the 
picture data A_ V1 to A 1a1 weight added is obtained, and is thus divided by the divider 112 to produce picture 
15 data (A. V1 + 2A. 1X > + A. 1§1 + 2Ao,.i + 4Ap^> + 2Ao t1 + A V1 + 2A 1i0 + A ti1 )/16. 

Thus, normalized 3x3 output data of the two dimensional filter circuit can be obtained by sequentially 
weight adding picture data of nine vertically and horizontally consecutive pixels. 

More specifically, a filter circuit with a characteristic defined by the following equation can be obtained by 
switching contacts of the selection circuits 102A, 102B, 108A and 108B 
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where multipliers of the multipliers 105 and 1 10 are a and b, and the divisor c of the divider 96 is expressed 
as (a + 2)(b + 2), 

The characteristics of the loop filter circuit 98 can be changed by switching contacts of the selection circuits 
40 102A, 102B, 108A and 108B depending on the position of the picture data Drr, within the data block. 

Thus, there is no need to use several kinds of filter circuits, and boundaries between data blocks can be 
made unobtrusive with a simple construction as a whole. 

In this embodiment, the vertical digital fitter circuit which outputs picture data consecutive in the vertical 
scanning direction from each of the delay circuits 101 A and 1 01 B is built by connecting the delay circuits 1 01 A 
45 and 101B in series whereas the selection circuits 102A and 102B and the adder 104 constitute a vertical selec- 
tion circuit which selectively outputs picture data outputted from the vertical digital fDter circuit. 

On the other hand, the horizontal digital filter circuit which outputs picture data consecutive in the horizontal 
scanning direction from each of the delay circuits 1 07A, 107B and 107C is built by connecting the delay circuits 
107A, 107B and 107C in series whereas the selection circuits 108A and 108B and the adder 109 constitute a 
so horizontal selection circuit which selectively outputs picture data outputted from the horizontal digital filter cir- 
cuit 

Furthermore, picture data Dpr 0 can be outputted in the order of inputted picture data by building the loop 
filt r circuit 98 in this manner, and ther by the construction of the input/output circuit fth loop f9t r circuit 98 
can be simplrfi d. 

55 In FIG. 16 square circuits 121, 122 and 123 output squares of pictur data D lND , drff rentiaJ data Dz and 

diff rential data Dr, resp ctiv ly. 

Arithmeticand loglcunit 124, 125, 126 and 127 add picture data D^and output data of the squares circuits 
121, 122 and 123 to utput data of latch circuits 128, 129, 130 and 131, resp ctively, and outputs results of 
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the summing to latch circuits 128, 129, 130 and 131 

Thus, the arithmetic and logic circuits 124, 125, 126 and 127 detect evaluation data D H1 , D H2 . D H3 and D^. 
defined by the following equations, for each macro block: 

D„i = S(A) (7) 

5 Dh2 = X(A)2 (8) 

D H3 = I(A-B)2 (9) 
D W = I(A.FB)2 (10 ) 

where A and B represents picture data D^o and picture data D^u and FB is the value of the output data Dp R0 
of the loop filter circuit 98. The evaluation data D m . D H2 , D H3 and Dh4 are outputted to a digital signal processing 
10 circuit 132. 

The digital signal processing circuit 132 is adds evaluation data D m , Dh* D H3 and D m to header D H et out- 
putted from the motion vector detection circuit 68, and outputs the resulting data to a digital signal processing 
circuit 134 through a buffer memory circuit 135. 

The digital signal processing circuit 134 is constituted by an operation processing circuit similarly with the 
15 digital signal processing circuit 1 32, and controls to switch the switch circuit 91 and the switch circuit 95 accord- 
ing to the header Dhet* 

More specifically, picture data is outputted to the subsequent discrete cosine transform circuit 71 for 
every predetermined frames according to the number of frame of the header Dhet* 

Thus, in the video signal transmission system video signals can be transmitted by intra coding every pre- 
20 determined frames. 

On the other hand, differential data Dpz is outputted to the discrete cosine transform circuit 71 for the remain- 
ing frames, and video signals inter coded are transmitted. 

In this event, the digital signal processing circuit 1 34 obtains results of comparison between the evaluation 
data Dh2. Dhs and D m and outputs picture data D (ND to the discrete cosine transform circuit 71 in place of dif- 
25 ferential data Dr when the evaluation data Dw is smaller than evaluation data Dks and CW 

More specifically, when the evaluation data D H2 is smaller than evaluation data D H3 and Dh4 according to 
the equations (8) to (10), picture data can be efficiently sent by transmitting picture data D,^ in place of diffe- 
rential data Dfz. 

Moreover, the digital signal processing circuit 134 outputs differential data D z to the discrete cosine trans- 
30 form circuit 71 in place of differential data when the evaluation data Dh4 is smaller than evaluation data 
D H2 and D H3 . 

That is, there is a case where boundaries between data blocks are unobtrusive event if differential data D z 
is coded, and there is another case where efficient transmission is performed by coding differential data D z for 
differential data Dp* 

35 Thus, as in this embodiment, video signals can be transmitted efficiently as a whole by switching the coding 

operation according to evaluation data D H i. Dh 2 , D H3 and D H4 - 

Furthermore, the digital signal processing circuit 134 removes evaluation data D w , D^, and Dm from 

the header D HE t outputted from the digital signal processing circuit 132, and then adds information to switch 

the switch circuits 91 and 95 to renew the header Dhet- The header Dhet renewed is outputted through the buffer 
40 memory circuit 136 to the discrete cosine transform circuit 71 . 

(6-3) Decoder circuit 

As shown in FIG..23, the decoder circuit 69 provides the picture data D INV and D 2 and the header Dhet 
outputted from the inverse discrete cosine transform circuit 75 to an adder 141 and a header detection circuit 
142. 

45 The header detection circuit 142 separates a frame number, address data of a block group, macro block 
and data blocks, and a motion vector from the header D HET for outputting to address data producing circuits 
143 and 145. 

The address data producing circuits 1 43 and 145 generate address data for writing to frame memory circuits 
146, 1 47 and 148, and at the same time produce address data for reading the frame memory circuit 146 accord- 
so ing to the motion vector. 

The header detection circuit 142 outputs identification data for inter and intra coding to a mode indication 
circuit 149 as well as switch signals SEL5 and SEL6 according to the identification data for inter and intra coding 
and according to on-off information of the loop filter circuit 

Thus, the header detection circuit 142 switches contacts f the selection circuits 1 50 and 1 51 , and switches 
55 the operati n f the decoder circuit 69 in accordance with picture data D^y and D z reconstructed in the inverse 
discrete cos in transf rm circuit 75. 

More specifically, in a case where picture data D\w intra coded is processed, the header det cti n circuit 
142 perf rms selective control of th earth contact of the selection circuit 150. 
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Thus, th picture data D (NV reconstructed in the inverse discrete cosine transform circuit 75 is outputted 
through the adder 141 and a clipping ircuit 152, and is stored in the frame memory circuits 146, 147 and 148 
according to address data outputt d from the write address data producing circuit 143. 

In a case where differentia! data D z inter coded selective control of the selection circuit 151 side contact 
5 of the selection circuit 1 50. 

This enables picture data outputted at a timing lagging by a motion vector from the frame memory circuit 
146 through a loop filter circuit 153 or a register circuit 154. 

Thus, the differential data D z reconstructed in the inverse discrete cosine transform circuit 75 is constituted 
by an operation processing circuit, and is actuated based on reference signals outputted from a control circuit 
10 133 synchronously with a system clock signal S C k- 

Furthermore, the digital signal processing circuit 132 adds evaluation data D H i. D H 2. D H3 and to header 
Dhet outputted from the motion vector detection circuit 68, and outputs the resulting data to a digital signal pro- 
cessing circuit 134 through a buffer memory circuit 135. 

The digital signal processing circuit 134 is constituted by an operation processing circuit similarly with the 
15 digital signal processing circuit 1 32, and controls to switch the switch circuit 91 and the switch circuit 95 accord- 
ing to the header Dhet- 

More specifically, picture data D IND is outputted to the subsequent discrete cosine transform circuit 71 for 
every predetermined frames according to the number of frame of the header Dhet- 

Thus, in the video signal transmission system video signals can be transmitted by intra coding every pre- 
20 determined frames. 

On the other hand, differential data is outputted to the discrete cosine transform circuit 71 for the remain- 
ing frames, and video signals inter coded are transmitted. 

In this event, the digital signal processing circuit 134 obtains results of comparison between the evaluation 
data Dh* Dh3 and D w and outputs picture data D (ND to the discrete cosine transform circuit 71 in place of dif- 
25 ferential data when the evaluation data D** is smaller than evaluation data and D H4 . 

More specifically, when the evaluation data Dh2 »s smaller than evaluation data D H3 and Dh* according to 
the equations (8) to (10), picture data can be efficiently sent by transmitting picture data D IND in place of diffe- 
rential data Dp* 

Moreover, the digital signal processing circuit 134 outputs differential data Dz to the discrete cosine trans- 
30 form circuit 71 in place of differential data Dpz when the evaluation data Dh* is smaller than evaluation data 
Dh2 and D H3 . 

That is, there is a case where boundaries between data blocks are unobtrusive even if differential data D z 
is coded, and there is another case where efficient transmission is performed by coding differential data D z for 
differential data D^. 

35 Thus, as in this embodiment, video signals can be transmitted efficiently as a whole by switching the coding 

operation according to evaluation data Dhi, Dh* D H3 and Dh 4 . 

Furthermore, the digital signal processing circuit 1 34 removes evaluation data Dm, Dh2. D H3 and from 

the header D H et outputted from the digital signal processing circuit 132, and then adds information to switch 

the switch circuits 9 1 and 95 to renew the header Dhet- The header Dhet renewed is outputted through the buffer 
40 memory circuit 1 36 to the discrete cosine transform circuit 71 . 

(6-3) Decoder circuit 

As shown in FIG. 23, the decoder circuit 69 provides the picture data CW and D z and the header Dhet 
outputted from the inverse discrete cosine transform circuit 75 to an adder 141 and a header detection circuit 
142. 

45 The header detection circuit 142 separates a frame number, address data of a block group, macro block 
and data block, and a motion vector from the header D H et for outputting to address data producing circuits 143 
and 145. 

The address data producing circuits 143 and 145 generate address data for writing to frame memory circuits 
146, 147 and 148, and at the same time produce address data for reading the frame memory circuit 146 accord- 
so ing to the motion vector. 

The header detection circuit 142 outputs identification data for inter and intra coding to a mode indication 
circuit 149 as w II as switch signals SEL5 and SEL6 according to th id ntificati ndataf r inter and intra coding 
and according to on-off information of th loop filter circuit 

Thus, the header detection circuit 142 switches contacts of the selection circuits 150 and 151, and switches 
55 the operation f th decoder circuit 69 in accordance with picture data D,nv and D z reconstruct d in th inv rse 
discret cosine transform circuit 75. 

More specifically, in a case where pictur data D (NV intra coded is process d, th h ader detecti n circuit 
142 performs selective c ntrol of the earth contact fthesel ction circuit 150. 
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Thus, the picture data D^v reconstructed in the inverse discrete cosine transform circuit 75 is outputted 
through the adder 141 and a dipping circuit 152, and is stored in the frame memory circuits 146, 147 and 148 
according to address data outputted from th write address data producing circuit 143. 

In a case where differential data D z inter coded is processed, the header detection circuit 142 makes a 
5 selective control of the selection circuit 151 side contact of the selection circuit 150. 

This enables picture data outputted at a timing lagging by a motion vector from the frame memory circuit 
146 through a loop filter circuit 153 or a register circuit 154. 

Thus, the differential data D z reconstructed in the inverse discrete cosine transform circuit 75 is added to 
the picture data shifted by the motion vector and read from the frame memory circuit 146 at the adder 141 , and 
10 is then stored in the frame memory circuits 146, 147 and 148 to thereby reconstruct the original picture data. 

In a case where the loop filter circuit 98 is selected in the differential data producing circuit 70(FIG. 16), 
the selection circuit 151 is controlled so that the loop filter circuit 1 35 side contact is selected in reconstructing 
corresponding picture data, and thereby the original picture data is reconstructed with reference to the picture 
data of the previous frame of which high frequency band has been suppressed similarly with the case of pro- 
fs ducing the differential data D r 

Thus, differential data Dpz which is constructed through the loop filter circuit 98 can be reconstructed 
through the loop filter circuit 153, and thereby boundaries between macro blocks can be made unobtrusive. 

The loop filter circuit 153 is constituted by a two dimensional filter circuit of the same configuration as the 
loop filter circuit 98(FIG. 1 7), and this enables characteristics of several kinds to be selected by merely switching 
20 contacts of the selection circuits. Thus, the construction of the decoder circuit 69 is simplified. 

The frame memory circuit 1 47 temporarily stores reconstructed picture data by sequentially storing the pic- 
ture data obtained through the adder 1 41 , and then outputs picture data Dsv to the motion vector detection circuit 
68 in the unit of a block group according to the address data outputted from the motion vector detection circuit 
68. 

25 This enables the motion vector detection circuit 68 to sequentially detect motion vectors according to the 
picture data Dsv reconstructed. 

. The frame memory circuit 148 selectively accepts picture data, obtained through the adder 141, and output 
data from the mode indication circuit 149 through the selection circuit 155, and outputs the data read in to a 
display 156. 

30 The mode indication circuit 149 outputs picture data of different chrominance signals depending on intra 
coding and inter coding operations. 

The selection circuit 155 outputs data concerning chrominance signals outputted from the mode indication 
circuit 149 to frame memory circuit 148 as well as picture data about luminance signals among picture data, 
outputted from the adder 141 , from the frame memory circuit 148 when a predetermined actuator is operated 

35 on. 

This enables the display 156 to display pictures different in color depending on intra coding and inter coding 
operations. 

Thus, at the end of the transmitter maintenance workers can confirm by visual observation pictures to be 
reconstructed at the destination. This enables the operation of the video signal transmission system 65 to be 
40 confirmed. In this event, It is possible to confirm according to differences in display colors whether Intra coding 
or inter coding is performed. 

As shown in FIG. 24, in which each of corresponding parts of FIG. 10 are designated by the same reference 
numeral, in a decoder circuit 86 the frame memory circuit 1 47 is omitted and the output data of the frame memory 
circuit 148 is outputted to the video signal processing circuit 87. 
45 This enables pictures sent from the destination to be monitored by the monitor 88(FIG. 15), and further it 
g possible to confirm by turning on the predetermined actuator according to a need whether intra coding or 
inter coding operation is performed at the destination. 

Thus, also in the decoder circuit 86 the overall construction can be simplified by using a loop filter circuit 
153 of the same configuration as the differential data producing circuit 70. 
so In a case where loop filter circuits are used in this type of the video signal transmission system, three loop 
filter circuits with the same characteristic are needed, and hence when individual loop filter circuits are com- 
plicated in construction, then the video signal transmission system as a whole becomes large-sized. 

How ver, if as in this embodiment, a loop filter circuit which is capable of selecting several kinds of charac- 
teristics by switching contacts of the selection circuits, the video signal transmission system 65(FIG. 15) as a 
55 wh le can be simplified with ease. 

(6-4) Operation of the third embodiment 

In the construction above, video signals S v outputted from the tel vision camera 66(FIG. 15) underg es 
the preliminary processing m the video signal processing circuit 67 to reduce the amount of data and are con- 
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verted t picture data D, N of th CCITT format. 

A m tion vector of picture data picture data is det cted for every macro block after the array of the pic- 
ture data is rearranged in the motion vector detection circuit 16. 

Here, picture data D PRI for comparison reference is produced according to the detected motion vector, and 
5 the picture data D PRJ is outputted to the differential data construction circuit 70 together with the picture data 
D, N0 (FIG. 16). 

In the differential data producing circuit 70, differential data D z Is produced by directly subtracting the picture 
data D PR] from the picture data D IND . 

Simultaneously, in the loop filter circuit 98(FIG. 17) the picture data Dp* is fed to the delay circuits 101A 
10 and 101B, and thereby picture data of the previous, current and next lines are produced. 

The picture data of the previous, current and next lines are selectively outputted through the selection cir- 
cuits 102A and 102B according to the picture data of the current line, and then added in the adder 104, after 
which the resulting data is added to the weighted picture data of the current line in the adder 106. 

This provides picture data in the vertical scanning direction with frequency characteristic according to 
15 selective outputs of the selection circuits 102A and 102B. 

The picture data D vo is fed to the delay circuits 107A, 107B and 107C, where picture data fo previous, cur- 
rent and next pixels are constructed. 

The picture data of the previous, current and next pixels are selectively outputted through the selection circuit 
108A and 108B according to the picture data of the current pixel to undergo addition in the adder 1 09, and are 
20 then added to weighted picture data of the current pixel at the adder 111. 

This enables picture data D PR0 to be provided in the horizontal scanning direction with frequency charac- 
teristic depending on selective outputs of the selection circuits 108A and 108B. 

The picture data Dp R0 of the loop filter circuit 98 is subtracted from the picture data D, ND to produce diffe- 
rential data Dpz- 

25 The evaluation data D H1 , Dh* D h3 and Dm of the equations (7) to (10) are detected from the picture data 
DiNo, and the differential data D z and differential data in the arithmetic and logic unit 124 to 127, and the 
picture data Dj N0 and the differential data D z and Dr are selectively outputted to the subsequent discrete cosine 
transform circuit 71(FIG. 1 5) according to evaluation data D H i. Dh2, Dh 3 and D m . 

In this manner, in the frames inter coded differential data D z and Dpz are outputted to the discrete cosine 

30 transform circuit 7 1 whereas in the frame intra coded picture data D rND is directly outputted to the discrete cosine 
transform circuit 71. 

The transformed data Dqct which has been obtained through the discrete cosine transform circuit 71 is 
quantized in the quantizer 72, and then undergoes the variable length coding processing in the variable length 
coding circuit 76 through the buffer circuit 77. The output data is sequentially sent to the destination through 
35 the transmission buffer circuit 73, the stuff bit adding circuit 78, the error correction circuit 79 and the multiplex 
conversion circuit 80. 

The output data of the quantizer 72 is decoded in the decoder circuit 69 to picture data through the inverse 
quantization circuit 74 and the inverse discrete cosine transform circuit 75, and the picture data Is outputted 
as picture data Dgy of the previous frame for detecting the motion vector. 
40 When the differential data Dpz which is produced through the loop filter circuit 98 is processed in this event, 
picture data of the previous frame outputted from the frame memory circuit 1 46(FlG. 24) is added to differential 
data Dpz through the loop filter circuit 153, and thereby boundaries between data blocks are made less obtru- 
sive. 

(6-5) Effects of the embodiment 
45 According to the foregoing construction, it Is possible that picture data of previous, current and next lines 
are selectively outputted, and that the selective output is switched by selectively outputrjng the picture data of 
the previous, current and next lines to thereby switch the characteristic of the loop filter circuit with a simple 
construction. 

so (7) Modifications of the third embodiment 

(7-1 ) In the mbodiment above described, it is stated that the characteristic of the loop filter circuit is switched 
as shown in FIG. 22. However, the present invention is not limited to this. If the contacts P1 and P2 are selected 
as shown in FIG. 25, for exampl , a filter characteristic as shown in FIG. 26 is obtained, and hence th present 
55 invention is widely applied t cases to obtain various characteristics according needs. 

(7-2) Moreover, in the abov mbodiment, the case where picture data f a current line and a current pixel are 
add dt th addition data of th adders 104 and 109 with weights is described but th present invention is not 
limit d to this. The additi n operation may b omitted according t needs. 
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(7-3) Furthermore, in the abov embodim nt, the case is stated in which after a characteristic is set in the vertical 
scanning direction, a horizontal scanning direction characteristic is set, but the present invention is n t restricted 
to this. Th picture data Dp ra may be inputted to the delay circuit 107A, the output data of the add r 1 1 1 may 
be outputted to the delay circuit 101 A, and the output data of the adder 106 may be divided by the divider 112. 
5 (7-4) in the foregoing embodiment, it is state that the present invention is applied to the video signal transmis- 
sion system for transmitting video signals together with voice signals but the present invention is not limited to 
this. The present invention may be widely applied to cases such as a case of transmitting video signals high 
efficiency coded and a case of saving a recording media. The present invention may be further applied to a 
two dimensional filter circuit to correct picture data in frequency characteristic. 

10 

(8) The fourth embodiment 

(8-1) Construction of the fourth embodiment 

In FIG. 27, 161 generally designates a picture phone system, which outputs video signal Sy and voice signal 
is S A to a destination through the line L1. 

In addition, the picture phone 161 demodulates data transmitted from the destination through the line L1 
to output video signal S V out and voice output signals S AO ut- 

For this purpose, the line connecting unit 162 performs a line connecting operation to Interconnect between 
the destination and the line L1. 
20 More specifically, when the line L1 is connected to a predetermined destination after a calling signal is out- 
putted to the line L1, the line connecting unit 162 detects a answer signal, so that the logic level of the control 
signals Scont rises. 

Moreover, the line connecting unit 162 cuts off the line L1 by outputting an on-hook signal after the con- 
versation is completed. 

25 On the other hand, a video signal transmission system 1 63 performs a coding operation of the video signal 
Sv by converting the video signals Sy to digital signals in a transmitter 163A, and then outputs the signals by 
multiplexing with digital voice signals. In this manner, pictures and voices of the speaker are outputted to the 
destination through the line connecting unit 162. 

In the coding opetation by converting the video signals Sy to digital signals, the video signal transmission 
30 system 1 63, as shown in FIG. 28, selects the intra coding operation to process picture data for a predetermined 
time interval T after the control signals Scont raises. 

After the lapse of the time interval T, picture data of every predetermined frames undergoes the intra coding 
operation and is then transmitted. 

In this manner, it is possible to intra code and send several frames of picture data immediately after con- 
35 nection of the line L1. 

It is thus possible to monitor a picture of the speaker at the end of the video signal transmission system 
163 just after the connection of the line L1, and hence natural communication is realized. 
Accordingly, it is possible to enhance facility of the video signal transmission system 163. 
Moreover, in the video signal transmission system 163, output data of the line connecting unit 162 is 
40 decoded in a receiver 163B, and then outputs video signal S VO ut and voice output signals Saout- In this manner, 
conversation is achieved, monitoring pictures of the speaker. 

The video signal transmission system 163, as described in FIG. 15, takes a picture of a speaker through 
a television camera 66, and the video signals Sy outputted from the television camera 66 are provided to a 
video signal processing circuit 67. 
45 (8-2) Operation of the fourth embodiment 

In the construction above, video signals S v outputted from the television camera 66 undergoes the preli- 
minary processing in the video signal processing circuit 67 to reduce the amount of data and are converted to 
picture data D, N of the CCITT format. 

A motion vector of picture data D iN is detected for every macro block after the array of the picture data is 
so rearranged in the motion vector detection circuit 68. 

Here, picture data D PW for comparison reference is produced according to the detected motion vector, and 
the picture data Dprj is outputted to the differential data construction circuit 70 together with the picture data 

D|NT> 

In the differential data c nstructi n circuit 70, th intra coding operation is selected at a predetermined 
55 frame eye! , and in this ev nt picture data Oind Is directly outputted to the discrete cosine transform circuit 71. 
On the ther hand, in the inter coding picture data Dp R , is subtracted from picture data D, ND to produc dif- 
ferential data D z and D^, which are outputted t th discret cosine transform circuit 71. 

When in this event the line L1 is connected and the logic level of the control signals Scont rises, picture 
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data D, N0 of frames are outputted to the discrete cosine transform circuit 71 by control switching of the switch 
circuit 91 by the digital signal processing circuit 134(FIG. 16). 

Thus, the intra frame operation is selected, and at the destination conversation may be had without unusu- 
alness, monitoring pictures of speaker just after the line L1 is connected. 
5 The transformed data Ddct which has been obtained through the discrete cosine transform circuit 71 is 
quantized in the quantizer 72, and then undergoes the variable length coding processing in the variable length 
coding circuit 76 through the buffer circuit 77. The output data is sequentially sent to the destination through 
the transmission buffer circuit 73, the stuff bit adding circuit 78, the error correction circuit 79 and the multiplex 
conversion circuit 80. 

10 The output data of the quantizer 72 is decoded In the decoder circuit 69 to picture data through the inverse 

quantization circuit 74 and the inverse discrete cosine transform circuit 75, and the picture data is outputted 

as picture data D S v of the previous frame for detecting the motion vector. 

(8-3) Effects of the fourth embodiment 

From the foregoing construction, picture data of several frames are intra coded and then sent just after the 
15 line L1 is connected, and thereby at the destination conversation may be had without unusualness, monitoring 

pictures of speaker just after the line L1 is connected. Thus, facility is improved compared to the prior art. 

(8-4) Modification of the fourth embodiment 

In the preceding embodiment, picture data of several frames are intra coded and then sent just after the 

line L1 is connected, and then switching is made to the normal operation. The present invention is not limited 
20 to this. For example, the operation may be switched to the intra frame coding just after the line L1 is cut off, 

and the connection of the line L1 may be waited for in the Intra coding mode. 

While there has been described in connection with the preferred embodiments of the invention, it will be 

obvious to those skilled in the art that various changes and modifications may be made therein without departing 

from the invention, and it is aimed, therefore, to cover in the appended claims all such changes and modifi- 
25 cations as fall within the true spirit and scope of the invention. 



Claims 

so 1. A video signal coding method in which video signals are alternatively intra and inter coded and are then 
quantized for transforming to picture data, characterized in that 

the quantization is executed by enlarging the quantization step size to a predetermined rough quan- 
tization level when the picture data to be quantized is in an intra coded format. 

35 2. A video signal coding system with a transmission buffer circuit, in which transmission picture data which 
has been high efficiency coded is temporarily stored in the transmission buffer circuit, and the transmission 
picture data stored is sequentially outputted to a transmission line according to a data transmission capacity 
of the transmission line, characterized in that: 

the transmission picture data is frame dropped when an amount of residual data of the transmission 
40 buffer circuit exceeds a predetermined upper limit; and 

the frame dropping operation is completed when the amount of the residual data of the transmission 
buffer circuit reduces to a predetermined desired level smaller than the upper limit. 

3. A filter circuit comprising: 
45 a vertical digital filter circuit having a plurality of delay circuits connected in series, each delay circuit 

outputting picture data consecutive in the vertical scanning direction; 

a vertical selection circuit for selectively outputting the picture data outputted from the vertical digital 
filter circuit; 

a horizontal digital filter circuit having a plurality of delay circuits connected in series, each delay 
so circuit outputting picture data consecutive in the horizontal scanning direction; and 

a horizontal selection circuit for selectively outputting the picture data outputted from the horizontal 
digital fit r circuit; and wherein: 

picture data are sequ ntially inputted to the vertical digital filter circuit or the horiz ntal digital filter 
circuit; th output data of the vertical selection circuit or the horizontal selection circuit is fed t theh riz ntal 
55 digital flit r circuit or the vertical digital niter circuit; the picture data outputted from the horizontal s lection 

circuit or th vertical sel ction circuit is corrected by switching the selective outputs from the vertical selec- 
tion circuit and the h rizontal selection circuit 
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4. A video signal processing apparatus including a filter circuit according t claim 3. 

5. A video signal transmlssi n system In which video signals are transmitted by repeating inter coding and 
Intra coding at a predetermined cycle, characterized in that* 

the video signals of predetermined frames are intra coded and then transmitted after a line is con- 
nected to a destination. 

6. A video signal coding method in which video signals are alternatively Intra and inter coded and are then 
quantized for transforming to picture data, characterized in that 

a power of said picture data is calculated when said picture data to be quantized is a data inter coded, 
and then said quantization Is executed with a quantization step size which is reduced data a predetermined 
ratio to a quantization step size of a previous frame when said power of picture data calculated is smaller 
than a predetermined threshold value. 

7. A video signal coding method in which video signals are alternatively intra and inter coded and are then 
quantized for transforming to picture data, characterized in that: 

a power of said picture data is calculated when said picture data to be quantized is a data Inter coded, 
and then said quantization is executed with a quantization step size which is enlarged to a predetermined 
rough quantization step size value when said power of picture data calculated Is larger than a predeter- 
mined threshold value. 
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